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TITLE OF THE INVENTION 
IMAGE PROCESSING APPARATUS AND METHOD, AND 
STORAGE MEDIUM 

FIELD OF THE INVENTION 
The present invention relates to an image 
processing apparatus and method, and a storage medium. 

BACKGROUND OF THE INVENTION 
Along with recent improvements of image qualities 
of color printers and color copying machines, it 
becomes very easy to copy and faithfully reproduce an 
original image as a print. This makes it easy to forge 
securities such as bank notes, and various measures 
against such forgery have been taken. 

Conventional anti-forgery techniques are roughly 
classified into a technique of recognizing an original 
as securities and inhibiting faithful printing and a 
technique of attaching, to a print, machine 
identification information for identifying a machine so 
as to specify a machine used for forgery of securities. 

Especially, for the latter technique of 
multiplexing machine identification information onto 
image information, various methods have been proposed 
and applied to not only anti-forgery of securities but 
also copyright protection, secret information 



protection, and character /voice data transmission. 

Methods of multiplexing information of a 
different kind such as machine identification 
information onto image information are roughly 
5 classified into a method of embedding information in a 
frequency domain and a method of embedding information 
in a real space domain. Embedding in a frequency 
domain is mainly implemented by converting image data 
from a real space domain into a frequency domain using 

10 a means such as FFT (Fast Fourier Transform) and then 
multiplexing additional information using a frequency 
component or phase component. On the other hand, 
embedding in a real space domain is implemented using 
quantization error which occurs when image data or the 

15 value of the least significant bit (LSB) of each pixel 
in the image data is quantized. 

For the shape of a code to be attached, for 
example, a method of attaching a dot pattern formed 
from a plurality of regions with different longitudinal 

20 directions has been proposed. 

However, the code used in the above method has a 
shape with a specific longitudinal direction. For this 
reason, when, e.g., image information is processed by 
pseudo-halftoning processing using error diffusion, and 

25 this code is attached to the image information, a 

continuos dot layout appears in a specific direction in 
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a highly dispersible dot layout unique to the error 
diffusion. Hence, the code is visually noticeable, 
resulting in degradation in image quality. 

To attach identification information for 
5 anti-forgery, information blocks each having a 

plurality of codes must be laid out in the entire image. 
As a consequence, the codes tend to be periodically 
laid out and are visually perceivable, resulting in 
degradation in image quality. 

10 For the shape of a code representing information, 

another method has been conventionally proposed in 
which in attaching, as a code, a dot pattern to an 
image expressed by pseudo-halftoning using error 
diffusion, a dot pattern that can appear in a flat 

15 image having an image density different from that of 

the region where the code is to be attached as a result 
of pseudo-halftoning expression using error diffusion 
is employed as a code shape, thereby suppressing 
degradation in image quality. 

20 In this conventional method, however, the code 

shape is represented by a dot pattern having a 
plurality of pixels in the vertical and horizontal 
directions. The dot pattern is registered in advance, 
and appropriately selected and used in accordance with 

25 the image density in the prior art using error 
diffusion . 
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To attach a code with less degradation in image 
quality, a dot pattern representing the code is 
selected in accordance with the density of a region 
where the code is to be attached. However, having a 
5 number of patterns increases, e.g., the number of 
program codes, hardware configuration, or memory 
capacity. 

In the above prior art, a dot pattern is 
generated in accordance with the average density of a 

10 region having a plurality of pixels, and used as a code. 
To do this, at the time of processing for the start row 
where code generation starts, the pixel values of rows 
to be processed later must be referred to. However, to 
prevent an increase in memory capacity and increase the 

15 processing speed, pseudo-halftoning processing may 

limit pixels to be referred to at once to one row. In 
this case, the image density can be detected only in 
the processing row, and the average pixel value of the 
entire region where the code is to be attached cannot 

20 be obtained. 

As another technique of multiplexing information 
of a different kind in an image processing apparatus 
for expressing an image using pseudo-halftoning 
processing, for example, in pseudo-halftoning 

25 processing using error diffusion or the like, a 

combination of quantization values that cannot occur is 



artificially generated, maintaining the image density, 
whereby information of a different kind is multiplexed 
while suppressing degradation in image quality. 

However, the above prior art has the following 
5 problems. 

(1) If information is multiplexed on a frequency 
component of image data or pixel value of full-color 
image data, a printing apparatus for printing an image 
using pseudo-halftoning expression do not guarantee 

10 that a code representing the multiplexed information 
should be preserved on a printing medium such as 
printing paper. 

(2) A recent printing apparatus has high 
resolution to improve the image quality. To detect a 

15 code embedded in an image, an image reading apparatus 
such as a scanner must also have high read resolution. 
To reliably read a code, the reading apparatus is 
required to have resolution higher by twice or more 
than that on the printing side due to the sampling 

20 theorem. However, the read resolution of an image 

reading apparatus such as a popular scanner is equal to 
or lower than the resolution of a printing apparatus 
such as an inkjet printer. Hence, if information of a 
different kind is multiplexed with image information 

25 without considering the resolution of the reading 
apparatus, an expensive special scanner with high 
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resolution must be used to reliably separate the 
information of the different kind from the printed 
image, resulting in impracticality . 

To control attachment of a code representing 
5 information, a method has been conventionally proposed 
in which in printing using achromatic colors that are 
not used for forgery of securities, no anti-forgery 
information such as the machine number of a printing 
apparatus is not attached. 

10 However, in the above-described code attachment 

control method, a code is attached to an output image 
containing chromatic colors even when the information 
cannot be decoded due to the image state. For this 
reason, a code is attached as long as the image 

15 contains chromatic colors, resulting in a decrease in 
printing speed in many cases. 

This influence is especially large when code 
attachment processing is performed not by hardware 
having relatively high processing speed but by software 

2 0 such as a printer driver. 

The outline of additional information 
superposition processing will be described. Fig. 104 
is a block diagram showing a general additional 
information embedding method. Referring to Fig. 104, 

25 an image signal represented by RGB components and input 
from a terminal 101 is converted into four components: 
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C (cyan) , M (magenta) , Y (yellow) , and K (black) by a 
color conversion section 102. These components are 
corrected by a various correction processing section 
103. Next, a pseudo-halftoning processing section 104 
5 executes pseudo-halftoning processing using a method 
such as systematic dithering or error diffusion. 

Additional information generated by an additional 
information generation section 105 is superposed 
(added) on the Y component of the image signal that has 

10 undergone the above processing operations. When these 
components are input to a printer engine 106, an image 
having certain information other than image information 
can be printed. 

Fig. 105 is a view showing a yellow plane to 

15 which a specific dot pattern is attached in order to 
superpose additional information. The hatched region 
(x [inch] ) shown in Fig. 105 is called an information 
area. The additional information is represented by the 
layout of dots in this region. 

20 However, the above-described method has the 

following problem. 

The above-described dot pattern attachment 
processing degrades the image quality because 
information that is not present on the image is 

25 attached. 

However, the degree of degradation in image 



quality largely depends on the texture of the image. 
More specifically, when the image to which additional 
information is to be attached is a very complex image 
containing a number of high-frequency components, 
5 degradation in image quality due to dot pattern 
attachment can hardly be visually confirmed. 

To the contrary, when the image is a relatively 
simple image containing a number of flat portions, an 
unnatural yellow dot may be easily visually confirmed. 

10 Conventionally, the degree of complexity of an 

image is detected using a certain method. Preferably, 
if it is determined that the image is complex, a dot 
pattern is attached as in the prior art, and if it is 
determined that the image is simple, the amount of dot 

15 pattern attachment is decreased as compared to the 
prior art. However, such a method has not been 
proposed yet. 

Additionally, when a predetermined dot pattern 
obtained by simple addition is attached, as in the 

20 above-described additional information superposition 

processing method, the number of pixels changes in the 
neighboring region. More specifically, a change in 
number of pixels on an image that has undergone 
pseudo-halftoning processing means a change in density. 

25 If this occurs, an unnatural dot may be visually 

confirmed even if a yellow component can hardly be 



visually detected. 

To avoid this situation, in attaching a dot 
pattern onto an image signal that has undergone 
pseudo-halftoning processing, certain processing must 
5 be executed to store the density (the number of pixels) 
in accordance with the situation of the neighboring 
portion . 

A method has been proposed in consideration of 
this problem, in which processing is executed for image 

10 information before pseudo-halftoning processing. 

However, a method of attaching a dot pattern to image 
information after pseudo-halftoning processing while 
storing the density has not been proposed. 

In a general method of superposing additional 

15 information onto an image, matrix points present at an 
N-pixel interval in a printable region are defined, as 
shown in Fig. 106, and additional information is 
expressed depending on whether a dot pattern 
predetermined and stored in a storage device in a 

20 computer or printer main body for executing processing 
is present at each matrix point. 

In the conventionally proposed scheme, generally, 
the same dot pattern is used for all density regions on 
an image. Attachment of a dot pattern onto image 

25 information using this conventional scheme will be 

described with reference to the accompanying drawings. 



Assume an image after pseudo-halftoning processing as 
shown in Fig. 107 as an image example before 
superposition of additional information. When a dot 
pattern shown in Fig. 108 is attached to the image 
5 shown in Fig. 107, an image shown in Fig. 109 is 
obtained. 

Referring to Fig. 109, in a density region 
(especially region A) having a pixel layout similar to 
that of the dot pattern, it is difficult to determine 

10 whether the dot pattern is present in the process of 
reading the attached information, and therefore, 
accurate additional information cannot be read. 

To avoid this situation, the dot pattern may have 
pixels at a smaller interval, as shown in Fig. 110. 

15 However, when the dot pattern having pixels at high 

density as shown in Fig. 110 is attached to the entire 
image, an unnatural dot may be visually confirmed in a 
region having very low density, conversely to the above 
case, although a yellow component is hard to visually 

20 detect. 

To avoid this state, in attaching a certain dot 
pattern to image information that has undergone 
pseudo-halftoning processing, processing of measuring 
the density, i.e., pixel density in the region around 
25 the attachment portion by some method and attaching an 
appropriate dot pattern in accordance with the 
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measurement result must be executed. However, such a 

method has not been proposed yet. 

Fig. Ill is a view showing an example of a yellow 

plane to which a specific dot pattern is added to 
5 superpose conventional additional information. 

Referring to Fig. Ill, a dot indicates a point where a 

dot pattern shown in Fig. 112 is attached. Fig. 113 is 

an enlarged view of Fig. 111. Referring to Fig. 113, a 

pixel represented by a dot is a pixel (to be referred 
10 to as an "on-dot" hereinafter) printed on a printing 

medium such as paper using ink or toner. 

In the above-described method, the dot pattern is 

generally embedded in the entire image at a 

predetermined period, as shown in Fig. 111. This 
15 predetermined period is an A-pixel period in the main 

scanning direction, and a B-pixel period in the 

sub-scanning direction. 

However, the above-described conventional method 

has the following problem. 
20 Figs. 114A to 114D are views showing CMYK 

components after pseudo-halftoning processing. 

Especially, the yellow plane shown in Fig. 114D 

indicates Y (yellow) components of the CMYK components. 

The dot pattern shown in Fig. 112 is attached to each 
25 of halftone dot regions. It is found that, in all the 

CMYK planes, neither region A nor B have on-dots. 



The conventional additional information 
superposition means attaches a dot pattern to all 
attachment positions on the Y plane, as shown in 
Fig. 115, regardless of the situation. 
5 For this reason, in a region such as the region A 

or B where no on-dots are present in all the CMYK 
planes, only pixels of the dot pattern are printed on a 
printing medium such as paper. Under these 
circumstances, an unnatural dot may be visually 

10 confirmed, though the yellow component is hard to 
visually detect. 

To avoid this situation, for example, in 
attaching a dot pattern onto the Y plane, processing of 
measuring, by some method, the density state (pixel 

15 distribution) around the position where the dot pattern 
is to be attached for all the CMYK components and 
determining in accordance with the measurement result 
whether the dot pattern should be attached is executed. 
Even when this processing is executed, the 

20 attached information can be restored because the dot 
pattern representing the presence of additional 
information is periodically present. However, such a 
method has not been proposed yet. 

25 SUMMARY OF THE INVENTION 

It is an object of the present invention to 
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provide an image processing apparatus and method, and a 
storage medium, all of which can solve at least one of 
the above problems. 

The present invention has been made to solve the 
5 above problems, and has as its another object to 
provide an image processing method and apparatus 
capable of multiplexing additional information without 
degrading image quality. 

The present invention has been made to solve the 

10 above problems, and has as its still another object to 
provide an image processing apparatus and method 
capable of minimizing degradation in image quality even 
when additional information is multiplexed on image 
information and also allowing even, e.g., a popular 

15 low-resolution image reading apparatus to properly 
separate and read the additional information from a 
printed image having the multiplexed additional 
information. 

It is still another object of the present 

20 invention to provide an image processing apparatus and 
method, and a storage medium, all of which can suppress 
degradation in quality of an image and embed 
predetermined information such that it can be easily 
detected. 

25 The present invention has been made to solve the 

above problem, and has as its still another object to 
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provide an image processing method and apparatus 
capable of superposing additional information with 
little visual incompatibility while maintaining the 
density of image information. 
5 The present invention has been made to solve the 

above problems, and has as its still another object to 
provide an image processing method and apparatus which 
can superpose additional information with little visual 
incompatibility and reduce the error rate of dot 

10 pattern detection in reading the additional information. 

In order to achieve the above-described object, 
according to a preferred aspect of the present 
invention, there is provided an image processing method 
of multiplexing a code representing additional 

15 information with image information, characterized by 
comprising : 

the shape setting step of setting code shape 
information on the basis of a feature of the image 
information; 

20 the quantization condition determination step of 

determining a quantization condition of a pixel of 
interest in the image information on the basis of the 
code shape information and the additional information; 
and 

25 the quantization step of quantizing the pixel of 

interest on the basis of the quantization condition. 



In order to achieve the above-described object, 
according to another preferred aspect of the present 
invention, there is provided an image processing 
apparatus for multiplexing additional information with 
5 image information, characterized by comprising: 

first input means for inputting the image 
information; 

second input means for inputting the additional 
information; 

10 quantization means for multiplexing the 

additional information with the image information and 
executing pseudo-halftoning processing so as to express 
the additional information by a set of minimum number 
of pixels readable by an image reading apparatus in 

15 consideration of resolution of an image output 

apparatus for outputting the image information as an 
image and resolution of the image reading apparatus for 
reading the image output from the image output 
apparatus; and 

20 output means for outputting image data processed 

by pseudo-halftoning processing by the quantization 
means . 

In order to achieve the above-described object, 
according to still another preferred aspect of the 
25 present invention, there is provided an image 

processing apparatus for reading an image having 
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additional information multiplexed thereon and 
separating the additional information, characterized by 
comprising : 

read means for reading the image ; 
5 detection means for detecting a position where 

the additional information is multiplexed in the image; 
and 

separation means for specifying the additional 
information multiplex position of the image on the 

10 basis of a detection result from the detection means 
and separating the additional information from the 
specified position. 

In order to achieve the above-described object, 
according to still another preferred aspect of the 

15 present invention, there is provided an image 
processing method of multiplexing additional 
information with image information and separating the 
additional information from an image having the 
additional information multiplexed, characterized by 

20 comprising: 

the first input step of inputting the image 
information; 

the second input step of inputting the additional 
information; 

25 the quantization step of multiplexing the 

additional information with the image information and 
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executing pseudo-halftoning processing so as to express 
the additional information by a set of minimum number 
of pixels readable by an image reading apparatus in 
consideration of resolution of an image output 
5 apparatus for outputting the image information as an 

image and resolution of the image reading apparatus for 
reading the image output from the image output 
apparatus; 

the output step of forming an image on the basis 
10 of image data processed by pseudo-halftoning processing 
and outputting the image; 

the read step of reading the image; 
the detection step of detecting a position where 
the additional information is multiplexed in the image; 
15 and 

the separation step of specifying the additional 
information multiplex position of the image on the 
basis of a detection result in the detection step and 
separating the additional information from the 

20 specified position. 

In order to achieve the above-described object, 
according to still another preferred aspect of the 
present invention, there is provided an image 
processing apparatus for attaching predetermined 

25 information to image information, characterized by 
comprising: 
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input means for inputting the image information; 

and 

attachment means for attaching a plurality of 
different predetermined information to different color 
5 components of the image information input by the input 
means, respectively. 

In order to achieve the above-described object, 
according to still another preferred aspect of the 
present invention, there is provided an image 
10 processing apparatus characterized by comprising: 

generation means for generating a plurality of 
types of second dot patterns corresponding to a first 
region smaller than a size of a first dot pattern 
representing predetermined information; and 
15 embedding means for selectively embedding the 

plurality of types of second dot patterns in units of 
first regions. 

In order to achieve the above-described object, 
according to still another preferred aspect of the 
20 present invention, there is provided an image 

processing apparatus for multiplexing image information 
and additional information different from the image 
information, characterized by comprising: 

decodability determination means for determining 
25 whether decoding is possible when a code is attached on 
the basis of a pixel value around a pixel of interest 



in the image information; and 

quantization condition determination means for 
determining quantization condition on the basis of a 
determination result from the decodability 
5 determination means, the pixel value around the pixel 
of interest in the image information, and the 
additional information to be multiplexed; and 

quantization means for quantizing the pixel of 
interest in the image information by pseudo-halftoning 
10 processing under the quantization condition determined 
by the quantization condition determination means. 

In order to achieve the above-described object, 
according to still another preferred aspect of the 
present invention, there is provided an image 
15 processing method of attaching predetermined 

information to image information, characterized by 
comprising the steps of: 

determining detectability of the predetermined 
information attached to the image information and 
20 attaching the predetermined information in accordance 
with the determined detectability. 

In order to achieve the above-described object, 
according to still another preferred aspect of the 
present invention, there is provided an image 
25 processing apparatus for superposing additional 

information different from image information on the 



image information and outputting the image information, 
characterized by comprising: 

input means for inputting the image information; 
pseudo-halftoning processing means for quantizing 
5 a pixel of interest in the image information; and 

additional information superposition means for 
selectively superposing a plurality of additional 
information each having a specific dot pattern in 
accordance with a density around the pixel of interest 
10 processed by the pseudo-halftoning processing means. 

There is also provided an image processing 
apparatus for attaching predetermined information to 
image information, characterized by comprising: 

input means for inputting the image information; 
15 holding means for holding a plurality of dot 

patterns having different densities; and 

attachment means for selectively attaching the 
dot patterns to the image information in accordance 
with a density of the image information. 
20 There is also provided an image processing 

apparatus for multiplexing image information and 
additional information different from the image 
information, characterized by comprising: 

input means for inputting the image information; 
25 quantization means for quantizing a pixel of 

interest in the image information; 
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dot pattern holding means for holding a specific 
dot pattern representing presence of the additional 
information in advance; 

attachment position information generation means 
5 for converting the additional information into position 
information as an attachment position of the dot 
pattern; 

density detection means for grasping a density 
state around the attachment position of the dot pattern, 
10 which is obtained by the attachment position 
information generation means; and 

additional information superposition means for 
determining, on the basis of a grasp result by the 
density detection means, whether the dot pattern is to 
15 be attached and superposing the additional information 
in accordance with a determination result. 

There is also provided an image processing 
apparatus for attaching predetermined additional 
information to image information, characterized by 
20 comprising: 

input means for inputting the image information; 
holding means for holding the additional 
information; 

detection means for detecting a density of the 
25 image information, which is represented by a plurality 
of color components of the image information around an 



attachment position of the additional information; and 
control means for, when the density of the image 
information, which is represented by the plurality of 
color components and detected by the detection means, 
5 has a predetermined value, controlling not to attach 
the additional information. 

There is also provided an image processing 
apparatus for superposing additional information 
different from image information on the image 
10 information and outputting the image information, 
characterized by comprising: 

input means for inputting the image information; 
pseudo-halftoning processing means for quantizing 
a pixel of interest in the image information; 
15 generation means for generating additional 

information having a specific dot pattern; and 

additional information superposition means for 
superposing the additional information, while 
maintaining a density around an attachment position of 
20 the additional information, in accordance with presence 
of a neighboring pixel around the attachment position 
of the additional information. 

There is also provided an image processing 
apparatus characterized by comprising: 
25 input means for inputting image information; 

holding means for holding predetermined 
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additional information; 

attachment means for attaching the predetermined 
additional information to the image information in 
units of pixels; and 
5 adjustment means for adjusting a density of the 

image information around an attachment position of the 
additional information in accordance with a density of 
the additional information. 

There is also provided an image processing method 
10 characterized by comprising: 

the input step of inputting image information; 
the holding step of holding predetermined 
additional information; 

the attachment step of attaching the 
15 predetermined additional information to the image 
information in units of pixels; and 

the adjustment step of adjusting a density of the 
image information around an attachment position of the 
additional information in accordance with a density of 
20 the additional information. 

There is also provided an image processing 
apparatus characterized by comprising: 

input means for inputting image information; 
generation means for generating an amount 
25 representing a degree of complexity of the image 
information; and 
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information attachment means for attaching 
predetermined information to the image information in 
accordance with the amount representing the degree of 
complexity. 

5 The present invention relates to an image 

processing apparatus having a new function, and a 
method and storage medium therefor. 

Other features and advantages of the present 
invention will be apparent from the following 
10 description taken in conjunction with the accompanying 
drawings, in which like reference characters designate 
the same or similar parts throughout the figures thereof. 



BRIEF DESCRIPTION OF THE DRAWINGS 
15 Fig. 1 is a block diagram showing the arrangement 

of an image processing apparatus according to an 
embodiment of the present invention; 

Fig. 2 is a view showing an error distribution 
matrix of this embodiment; 
20 Fig. 3 is a flow chart showing the code 

attachment control procedure of this embodiment; 

Fig. 4 is a view showing an. attached information 
block of this embodiment; 

Figs. 5A and 5B are views showing binarization of 
25 a flat image of this embodiment; 

Fig. 6 is a view showing a code pattern of this 
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embodiment ; 

Fig. 7 is a view showing threshold values for 
code generation of this embodiment; 

Figs. 8A and 8B are views showing code attachment 
5 of this embodiment; 

Fig. 9 is a view showing code attachment to an 
edge portion in this embodiment; 

Fig. 10 is a view showing a code pattern at an 
edge portion in this embodiment; 
10 Fig. 11 is a block diagram showing the 

arrangement of an image processing apparatus according 
to another preferred embodiment of the present 
invention; 

Fig. 12 is block diagram showing the arrangements 
15 of a multiplexing apparatus for multiplexing additional 
information with image information and printing the 
image and a separation apparatus for reading the image 
having the multiplexed additional information and 
separating the additional information, respectively; 
20 Fig. 13 is a flow chart showing code attachment 

processing according to this embodiment; 

Fig. 14 is a flow chart showing code separation 
processing according to this embodiment; 

Figs. 15A to 15C are views showing a quantization 
25 result of image information according to this 
embodiment ; 
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Fig. 16 is a block diagram showing the 
arrangement of a multiplexing apparatus according to 
this embodiment, which multiplexes additional 
information with image information and prints the 
image; 

Fig. 17 is a flow chart showing code attachment 
processing according to this embodiment; 

Fig. 18 is a block diagram showing the 
arrangement of a multiplexing apparatus according to 
still another embodiment, which multiplexes additional 
information with image information and prints the 
image ; 

Fig. 19 is a view showing pieces of different 
information are attached to the color components of an 
input image, respectively; 

Fig. 20 is a flow chart showing code attachment 
processing according to this embodiment; 

Figs. 21A and 21B are views showing a dither 
matrix according to this embodiment and a binarization 
result using the matrix; 

Fig. 22 is a block diagram showing the 
arrangement of an image processing apparatus according 
to still another embodiment; 

Figs. 23A to 23D are views showing dot patterns 
held in a code pattern memory; 

Figs. 24A to 24C are views showing code shapes 



formed from the held dot patterns; 

Fig. 25 is a flow chart showing the code 
attachment control procedure of this embodiment; 

Figs. 26A to 26F are views for explaining a code 
for high density and a code for low density; 

Fig. 27 is a view showing a dot pattern selection 
method of this embodiment; 

Fig. 28 is a flow chart showing the code 
attachment control procedure of this embodiment; 

Fig. 29 is a block diagram showing the 
arrangement of an image processing apparatus according 
to still another embodiment; 

Figs. 30A and 30B are views showing errors 
generated upon code attachment in this embodiment; 

Fig. 31 is a flow chart showing the code 
attachment control procedure of this embodiment; 

Fig. 32 is a flow chart showing the code 
attachment control procedure of still another 
embodiment; 

Fig. 33 is a block diagram showing the 
arrangement of the image processing apparatus according 
to still another embodiment; 

Figs. 34A to 34F are views showing the dot 
pattern selection method of this embodiment ; 

Fig. 35 is a flow chart showing the code 
attachment control procedure of this embodiment; 



Fig. 36 is a view showing the dot pattern 
selection method of still another embodiment; 

Fig. 37 is a flow chart showing the code 
attachment control procedure of this embodiment; 
5 Fig. 38 is a block diagram showing the 

arrangement of an image processing apparatus according 
to still another embodiment; 

Figs. 39A and 39B are views showing the state of 
a quantization value difference buffer in this 
10 embodiment; 

Fig. 40 is a flow chart showing the code 
attachment control procedure of this embodiment; 

Fig. 41 is a flow chart showing the code 
attachment control procedure of still another 
15 embodiment; 

Fig. 42 is a schematic block diagram showing the 
arrangement of an image processing apparatus according 
to still another embodiment of the present invention; 

Fig. 43 is a block diagram showing the detailed 
20 arrangement of an image quantization section shown in 
Fig. 42; 

Fig. 44 is a flow chart showing the operation 
procedure of the image quantization section of the 
embodiment shown in Fig. 43; 
25 Fig. 45 is a view showing an information block of 

this embodiment; 
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Fig. 4 6 is a view showing information attachment 
according to an image density in code attachment 
processing of this embodiment; 

Fig. 47 is a flow chart showing the operation 
5 procedure of this embodiment; 

Fig. 48 is a flow chart showing the operation 
procedure of this embodiment; 

Fig. 4 9 is a view showing information attachment 
to an edge portion in this embodiment; 
10 Fig. 50 is a view showing additional information 

superposition in this embodiment; 

Fig. 51 is a view showing a dot pattern to be 
attached; 

Fig. 52 is an enlarged view of a yellow plane to 
15 which the dot pattern is attached; 

Fig. 53 is a block diagram showing processing in 
this embodiments- 
Fig. 54 is a view showing a data format after 
compression processing in this embodiment; 
20 Figs. 55A and 55B are views showing the layouts 

of information areas in this embodiment; 

Fig. 56 is a block diagram showing processing in 
this embodiment; 

Fig. 57 is a flow chart showing the flow of 
25 processing of a degree-of -complexity detection section 
of this embodiment; 
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Fig. 58 is a view showing block segmentation in 
this embodiment; 

Fig. 59 is a view showing DCT coefficients used 
in this embodiment; 
5 Fig. 60 is a block diagram showing the additional 

information superposition method of an image processing 
apparatus according to still another embodiment; 

Fig. 61 is a view showing an image that has 
undergone pseudo-halftoning processing in this 
10 embodiment; 

Fig. 62 is a view showing generated additional 
information position; 

Figs. 63A and 63B are views showing dot patterns 
in this embodiment; 
15 Fig. 64 is a flow chart showing additional 

information superposition processing in this 
embodiment ; 

Fig. 65 is a view showing a density reference 
region in this embodiment; 
20 Fig. 66 is a view showing a density threshold 

value in the first embodiment; 

Figs. 67A and 67B are views showing images before 
and after a dot pattern is attached using processing in 
this embodiment; 
25 Fig. 68 is a view showing an image that has 

undergone pseudo-halftoning processing in still another 



- 30 - 



embodiment; 

Fig. 69 is a flow chart showing additional 
information superposition processing in this 
embodiment ; 

5 Figs. 70A and 70B are views showing dot patterns 

used in this embodiment; 

Fig. 71 is a view showing a dot pattern used in 
this embodiment; 

Fig. 72 is a view showing a density reference 
10 region in this embodiment; 

Fig. 73 is a view showing a density threshold 
value and dot pattern to be used in this embodiment; 

Figs. 74A and 74B are views showing image 
examples before and after a dot pattern is attached 
15 using processing in this embodiment; 

Fig. 75 is a block diagram showing the 
arrangement of an image processing apparatus according 
to a preferred embodiment of the present invention; 

Figs. 76A to 76D are views showing images after 
20 pseudo-halftoning processing of this embodiment; 

Fig. 77 is a view showing generated attachment 
position information; 

Fig. 78 is a view showing a dot pattern and dot 
pattern data used in this embodiment; 
25 Fig. 7 9 is a flow chart showing details of 

additional information superposition processing in this 
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embodiment; 

Figs. 80A to 80D are views showing density 
reference regions of this embodiment; 

Figs. 81A to 81D are views showing images after 
additional information superposition processing in this 
embodiment; 

Figs. 82A to 82D are views showing images that 
have undergone pseudo-halftoning processing of this 
embodiment ; 

Fig. 83 is a flow chart showing details of 
additional information superposition processing of this 
embodiment ; 

Figs. 84A to 84D are views showing density 
reference regions of this embodiment; 

Figs. 85A to 85D are views showing images after 
additional information superposition processing of this 
embodiment ; 

Fig. 8 6 is a block diagram showing the additional 
information attachment superposition method of the 
image processing apparatus of this embodiment; 

Fig. 87 is a view showing an image to which a dot 
pattern is attached; 

Fig. 8 8 is a view showing a dot pattern in this 
embodiment; 

Fig. 8 9 is a view showing generated attachment 
position information; 
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Fig. 90 is a flow chart showing additional 
information superposition processing in this 
embodiment ; 

Figs. 91A and 91B are views showing images before 
5 and after the dot pattern in this embodiment is 
attached; 

Fig. 92 is a view showing an image that has 
undergone pseudo-halftoning processing in this 
embodiment ; 

10 Fig. 93 is a flow chart showing additional 

information superposition processing in this 
embodiment ; 

Fig. 94 is a view showing a dot pattern to be 
used in this embodiment; 
15 Fig. 95 is a view showing a density storage 

region in this embodiment; 

Figs. 96A and 96B are views showing images before 
and after off -dot processing in this embodiment; 

Fig. 97 is a view showing an image that has 
20 undergone pseudo-halftoning processing in this 
embodiment ; 

Fig. 98 is a flow chart showing additional 
information superposition processing in this 
embodiment ; 

25 Fig. 99 is a view showing a dot pattern to be 

used in this embodiment; 
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Fig. 100 is a view showing the database of the 
dot pattern in this embodiment; 

Fig. 101 is a view showing the order of off-dot 
processing in this embodiment; 
5 Fig. 102 is a view showing the database of 

off -dot processing in this embodiment; 

Figs. 103A and 103B are views showing images 
before and after off -dot processing in this embodiment; 

Fig. 104 is a block diagram showing conventional 
10 additional information superposition processing; 

Fig. 105 is a view showing a yellow plane to 
which a dot pattern is attached; 

Fig. 106 is a view showing an image to which the 
dot pattern is attached; 
15 Fig. 107 is a view showing an image after 

pseudo-halftoning processing; 

Fig. 108 is a view showing a dot pattern to be 
attached; 

Fig. 109 is a view showing an image after 
20 conventional dot pattern attachment processing; 

Fig. 110 is a view showing a dot pattern having a 
smaller pixel interval; 

Fig. Ill is a view showing a yellow plane to 
which a general dot pattern is attached; 
25 Fig. 112 is a view showing a conventional dot 

pattern to be attached; 
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Fig. 113 is an enlarged view of a yellow plane to 
which the conventional dot pattern is attached; 

Figs. 114A to 114D are views showing CMYK 
components after conventional pseudo-halftoning 
5 processing; and 

Fig. 115 is a view showing a Y plane after dot 
pattern attachment processing by a conventional dot 
pattern attachment method. 

10 DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Preferred embodiments of the present invention 
will be described below in detail with reference to the 
accompanying drawings. An image processing apparatus 
according to an embodiment is efficiently mainly 

15 incorporated as printer driver software or application 
software in a computer for generating image information 
to be output to a printer engine. However, it is also 
effective to incorporate the image processing apparatus 
as hardware and software in a copying machine, 

20 facsimile apparatus, or printer main body. 

Fig. 1 is a block diagram showing the arrangement 
of an image processing apparatus according to an 
embodiment, which can be applied to a printing 
apparatus such as an inkjet printer for forming an 

25 image using pseudo-halftoning expression. 

Referring to Fig. 1, an input terminal 100 inputs 
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image information, and an input terminal 101 inputs 
additional information such as identification 
information. A quantization condition determination 
section 102 determines a quantization condition for 
5 quantization of image information. The quantization 
condition determination section 102 holds, as a table, 
a plurality of quantization conditions in an internal 
ROM (not shown) in advance and selects an appropriate 
quantization condition. A code pattern memory 103 
10 holds a plurality of types of dot patterns each 

representing one code of additional information. The 
held code patterns are referred to by the quantization 
condition determination section 102 to determine the 
quantization condition. A quantization section 104 
15 quantizes image information. The quantization section 
104 quantizes image information by a method such as 
error diffusion on the basis of the quantization 
condition determined by the quantization condition 
determination section 102. An output terminal 105 
20 outputs the quantized image information. 

Error diffusion is a method of expressing, by 
pseudo-halftoning, multilevel image information using 
binary values or quantization values smaller than the 
input image information. In this quantization method, 
25 an error generated upon quantizing a pixel value of 

interest is distributed to pixels around the pixel of 
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interest, thereby storing the image density. 

Fig. 2 is a view showing an error distribution 
matrix of error diffusion. Referring to Fig. 2, * 
represents the position of a pixel of interest, and a 
to 1 represent the distribution ratios of a 
quantization error generated in the pixel of interest. 
The error is distributed to neighboring pixels of the 
pixel of interest in accordance with the distribution 
ratios. In the example shown in Fig. 2, the error is 
distributed to 2 x 2 pixels around the pixel of 
interest. However, the error distribution range is not 
limited to this. In this embodiment, assume that the 
code attachment interval is constant in the vertical 
direction and is changed in the horizontal direction. 

Fig. 3 is a flow chart showing the code 
attachment control procedure of this embodiment. 

First, in step S300, a variable i for counting 
the vertical address and a variable j for counting the 
horizontal address are initialized. In step S301, it 
is determined whether code attachment is to be executed 
for a row indicated by the row address i. If YES in 
step S301, it is determined in step S302 whether code 
attachment is to be executed for a column indicated by 
the column address j . 

If it is determined in steps S301 and S302 that a 
pixel of interest indicated by the addresses i and j is 



a code attachment position, the flow advances to step 
S303. In this embodiment, an additional code is 
represented by a code pattern formed from a 
predetermined layout of a plurality of dots. For this 
5 reason, in step S303, coordinate values in the code 

pattern of the pixel of interest are calculated on the 
basis of the coordinate values (i,j) of the pixel of 
interest, and in step S304, an image density d around 
the pixel of interest (i,j) is detected. 
10 The code pattern of this embodiment is set in 

accordance with the target code attachment image from a 
plurality of dot patterns held in the code pattern 
memory 103. This code pattern is set before the start 
of code attachment processing. The setting method will 
15 be described later. 

In step S305, the quantization condition 
determination section 102 acquires a quantization 
condition for code attachment from the table in which a 
plurality of quantization conditions are registered in 
20 advance, on the basis of the image density d around the 
pixel of interest, the coordinate values in the code 
pattern, and the additional information. After that, 
in step S306, pseudo-halftoning processing 
(quantization processing by the quantization section 
25 104) for image information is executed. With this 

pseudo-halftoning processing, actual code attachment in 
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this embodiment is executed. 

On the other hand, if it is determined in step 
S301 or S302 that the pixel of interest is not a pixel 
position where code attachment is to be executed, the 
5 flow advances to step S307 to acquire a normal 

quantization condition without code attachment, and 
then, pseudo-halftoning processing for image 
information is executed in step S306. 

In step S308, the count value of the column 
10 address j is incremented by one. In step S309, it is 
determined whether processing in the column direction 
is ended. If NO in step S309, the flow returns to step 
S302. If YES in step S309, the flow advances to step 
S310. 

15 In step S310, the column address j is initialized. 

After that, in step S311, the count value of the row 
address i is incremented by one. In step S312, it is 
determined whether processing for all rows is ended. 
If NO in step S312, the flow returns to step S301. If 

20 YES in step S312, the code attachment processing is 
ended. 

Fig. 4 is a view showing an information block 
representing 4-bit information attached to image 
information in this embodiment. Referring to Fig. 4, " 
25 represents one code, i.e., a code pattern formed 

from a plurality of dots. 



Referring to Fig. 4, an information bit is 
expressed in accordance with the interval of additional 
codes in units of code attachment rows in image 
information. According to Fig. 4, the code interval is 
5 constant in the same row. When the code interval 

corresponds to an odd number of codes, it represents an 
information bit "1". A code interval corresponding to 
an even number of codes represents an information bit 
"0". That is, the information block represents 4-bit 
10 information "1010". 

In the anti-forgery technique which must reliably 
detect additional information from an image, the 
information block shown in Fig. 4 is embedded at any 
position in the entire image information. The 
15 information block shown in Fig. 4 is merely an example, 
and the present invention is not limited to this. 

Generally, when a code representing specific 
information is attached in an image represented by 
pseudo-halftoning, the image quality degrades because 
20 the code is visually perceived. However, when a code 

is attached as a measure against forgery of securities, 
the code must be repeatedly attached in a wide range of 
an image so that the attached specific information can 
be reliably detected. Hence, the code itself must be 
25 unnoticeable . 

As a method of making a code unnoticeable, a code 
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in small size is used. However, this method is 
impractical because an image reading apparatus used to 
detect the code must have a high-resolution reading 
function, and the optimum read resolution changes in 

5 units of printing apparatuses. 

As another method, a code having an unnoticeable 
pattern shape is used. However, the dot layout of an 
image expressed by pseudo-halftoning largely depends on 
the pseudo-halftoning processing method. For example, 

10 when pseudo-halftoning processing using error diffusion 
is performed, and the error distribution ratio in the 
error distribution matrix shown in Fig. 2 is changed, 
the dot layout of the output image changes. In 
addition, as a feature of the dot layout of an output 

15 image in a window having a predetermined size, 

especially at a flat image portion formed from a 
character, a specific pattern appears many times while 
another specific pattern does not appear at all. 
Furthermore, the pattern appearance rate also changes 

20 depending on the image density. A pattern that does 
not appear at a certain image density may appear at 
another density. 

Considering the above-described characteristic 
features of pseudo-halftoning processing using error 

25 diffusion, a code pattern used in this embodiment and 
its attachment processing will be described in detail. 
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The code pattern of this embodiment will be 
described first with reference to Figs. 5A to 7. 

Figs. 5A and 5B are views respectively showing 
parts of images obtained by binarizing a flat image 
having a density of about 2% (5/256) and a flat image 
having a density of about 6% (15/256) by error 
diffusion. Fig. 6 is a view showing a 5 X 5 dot 
pattern window which represents the layout pattern of 
dots that appear at a portion 500 in Fig. 5B. The 
pattern shown in Fig. 6 does not appear in Fig. 5A. 

In this embodiment, for the image density (about 
2%) corresponding to Fig. 5A, the pattern shown in 
Fig. 6 is set as a code (to be referred to as a code 
pattern hereinafter) distinguishable from image 
information. More specifically, of the plurality of 
code patterns held in the code pattern memory 103, the 
pattern shown in Fig. 6 is selected by the quantization 
condition determination section 102 for a flat image 
having an image density of 2%. Code patterns held by 
the code pattern memory 103 can appear in the 
quantization result of a flat portion having a certain 
density. Hence, in this embodiment, a natural dot 
pattern can always be set as a code pattern. 

Fig. 7 is a view showing threshold values used to 
generate the code pattern shown in Fig. 6 in executing 
pseudo-halftoning expression using error diffusion. 



The accumulation of errors in error diffusion falls 
within a predetermined range. For this reason, when 
the threshold value for binarization is set to be equal 
to or smaller than a predetermined value, a dot 
5 corresponding to the threshold value can always be 

turned on. In the pixel block shown in Fig. 7, for X 
corresponding to pixels at four corners, a threshold 
value is set to always turn the dots on. For Y 
corresponding to the remaining pixels, a threshold 
10 value for normal processing is set. Using the thus 
generated threshold value block shown in Fig. 7, the 
code pattern shown in Fig. 6 can be reliably generated. 

An example in which the code pattern in this 
embodiment is actually attached to an image will be 
15 described in detail with reference to Figs. 8A and 8B. 
Fig. 8A is a view showing an output image 
obtained by binarization processing of attaching, as 
codes 800, 801, 802, and 803, the code pattern shown in 
Fig. 6 to an image having the same density as that in 
20 Fig. 5A. 

Fig. 8B is a view showing an output image 
obtained by binarization processing of attaching, as 
codes 804, 805, 806, and 807, a pattern different from 
the code pattern shown in Fig. 6 to an image having the 
25 same density as that in Fig. 5A. Each of the patterns 
804 to 807 has dots equal in number to those of the 
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code pattern (codes 800 to 803 shown in Fig. 8A) shown 
in Fig. 6 but different in shape. This pattern does 
not appear in a flat portion in normal binarization 
processing . 

5 As is apparent from Figs. 8A and 8B, the code 

pattern (codes 800 to 803) set in this embodiment is 
more unnoticeable . More specifically, degradation in 
image quality upon code attachment can be suppressed by 
setting, as a code pattern, an unnoticeable pattern at 

10 a flat portion with this density. 

In this embodiment, using the fact that the dot 
pattern shown in Fig. 6 does not appear at the density 
shown in Fig. 5A, this pattern is employed as a code 
pattern. However, an actual image does not always have 

15 a completely flat portion, and the pixel value may 
fluctuate in units of regions. Hence, in actually 
setting a code pattern, it must be confirmed that the 
pattern does not appear not only for a target density 
region but also for a neighboring density region. 

20 In this embodiment, the density in the window 

forming the code pattern shown in Fig. 6 is higher than 
the average density of the image shown in Fig. 5A. 
Generally, for a pattern that hardly appears at a 
certain density but appears at another density, the 

25 density in the window is often largely different from 

the target image density. For the code pattern of this 
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embodiment, the density in the window is higher or 
lower than the target image density. If the target 
image density is low, the density of the code pattern 
in the window is set higher than the target image 
5 density. Conversely, if the target image density is 

high, the density of the code pattern in the window is 
set lower than the target image density. More 
specifically, the number of on- or off-dots smaller in 
number than the other in the code pattern is set to be 

10 larger than that of a dot pattern that appears as a 

quantization result of the target image. This prevents 
the code pattern from being hidden in the dot layout of 
the image and becoming undetectable. 

In this embodiment, the window size of code 

15 pattern is 5 x 5, as shown in Fig. 6. However, the 
window size is not limited to this, and the aspect 
ratio of window is not limited to this, either. That 
is, the code pattern shown in Fig. 6 is merely an 
example, and the present invention is not limited to 

20 this. 

The dot pattern which appears upon binarization 
changes in accordance with the image density. For this 
reason, when the code pattern is changed in accordance 
with the image density, a more unnoticeable code shape 
25 can be set. It is also effective to change the window 
size of the code pattern in accordance with the image 
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density . 

As described above, according to this embodiment, 
when information of a different kind is to be 
multiplexed with image information obtained by 
5 expressing image information particularly having a 
number of flat portions by pseudo-halftoning, 
degradation in image quality can be suppressed by 
making the shape of code for expressing the information 
unnoticeable . 

10 Another embodiment of the present invention will 

be described below. 

As a characteristic feature of this embodiment, 
in attaching a code to a color image, the code shape is 
changed in units of color components. 

15 Generally, a printing apparatus such as an inkjet 

printer or color laser printer prints a color image 
using C (cyan), M (magenta), Y (yellow), and K (black) 
inks or toners. In such color printing, even when the 
same shape is formed, the visual impression changed 

20 depending on the color component. For example, assume 

that a dot is printed on white paper. If K ink is used, 
the dot is noticeable. However, when Y ink is used, 
the dot is unnoticeable. 

When information such as the machine number of an 

25 apparatus used for printing is attached for 

anti-forgery of securities, the additional information 
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must be reliably detected. As a method of attaching a 
number of pieces of information in a small number of 
regions as much as possible, the information is 
divisionally attached to a plurality of color 
5 components. To reliably detect information regardless 
of the image, it is effective to attach information to 
a plurality of color components to increase the range 
of information readable condition. 

However, because of the above-described visual 
10 sensitivity to ink colors, even when codes having 

identical shapes are attached to the respective colors, 
the code may be noticeable depending on colors. 

As a characteristic feature of this embodiment, 
in attaching a code to a color image, the shape of code 
15 pattern is controlled in accordance with the visual 
sensitivity to a dot of each color component. More 
specifically, the code pattern shape is determined with 
emphasis on the unnoticeablity rather than the code 
attachment efficiency. 
20 It is also effective to change the size of code 

pattern in units of color components. 

In this embodiment, the code pattern shape is set 
following the same procedure as in the above-described 
embodiment . 

25 As described above, according to this embodiment, 

the code pattern shape is controlled in consideration 
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of the visual sensitivity of a color component to which 
a code is to be attached, thereby reducing degradation 
in image quality of a color image. 

Still another embodiment of the present invention 
5 will be described below. 

In the above-described embodiment, the code 
pattern is multiplexed especially at the flat portion 
of an image. However, actual image information may 
contain an edge portion. Particularly, when code 

10 attachment is to be executed for the purpose of 

anti-forgery of securities, an image as an attachment 
target contains characters, pictures, or patterns, i.e., 
many edge portions. Hence, to reliably read the 
additional information, the code pattern is preferably 

15 detected even at an edge portion. 

In this embodiment, code pattern shape control at 
an edge portion will be described. 

A code pattern used on the low density side of an 
edge portion has only a dot density almost hidden in 

20 the low-density region. Hence, at the edge portion, 
for example, the code pattern is hidden in the edge 
portion. If only half of the code pattern is detected, 
the detected dots can hardly be determined as the code 
pattern, i.e., the code. On the high-density side of 

25 the edge portion as well, the code can hardly be 

detected if the code pattern is formed from, e.g., 
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dispersed dots. 

As a characteristic feature of this embodiment, a 

code pattern which can be reliably detected even at an 

edge portion of an image is set. 
5 Fig. 9 is a view showing code attachment to an 

edge portion of an image. Referring to Fig. 9, 

reference numerals 900, 901, and 902 denote attached 

codes. The code 900 is unnoticeable in a low-density 

region under the quantization condition, like the code 
10 8 00 in the above-described embodiment. On the other 

hand, the codes 901 and 902 are at an edge portion as a 

characteristic feature of this embodiment. 

Fig. 10 is a view showing a code pattern 

corresponding to the codes 901 and 902. As is apparent 
15 from Fig. 10, a pattern having low dot dispersion, i.e., 

a pattern having dots densely is set as a code at the 

edge portion. 

It is very effective to make the code pattern 

size large to reliably discriminate the code even when 
20 only part of the code pattern is detected. It is also 

effective to set the code pattern in consideration of 

the edge shape. 

As described above, according to this embodiment, 

especially, when a code is attached to an edge portion 
25 of an image, the code can be reliably identified even 

when, e.g., only part of the code pattern is detected, 
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by setting a code pattern including dots densely. 

As has been described above, according to the 
present invention, additional information can be 
multiplexed without degradation in image quality. 
5 Fig. 11 is a block diagram showing the 

arrangement of an image processing apparatus according 
to another preferred embodiment of the present 
invention. As shown in Fig. 11, this apparatus 
comprises a host computer (to be referred to as a host 
10 hereinafter) 100 for processing image information, a 
scanner 110 for reading an image original and 
generating image information, a communication interface 
(I/F) 120 for receiving image information through a 
communication line, a LAN interface 130 for receiving 
15 image information through a LAN, a display 140 such as 
an LCD, PDP, FED, or CRT for displaying image 
information as an image, a printer 150 for outputting 
image information to a printing medium such as printing 
paper as an image, a keyboard (KB) 160 used to perform 
20 various man-machine operations necessary for image 
processing, and a mouse 170. 

The host 100 has a CPU for executing image 
processing or communication control processing, a ROM 
which stores a control program and the like, a RAM used 
25 to store image information or as a working area for 
image processing, a hard disk or magnetooptical disk 
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for storing a large quantity of data, and an interface 
for connecting various peripheral devices. 

Data received by the communication interface 
(I/F) 120 can be facsimile data or digital image 
5 information input through the Internet. 

The printer 150 is basically constructed by a 
printer controller serving as an interface to the host 
100, and a printer engine. The printer engine can be a 
printer engine according to an inkjet scheme, a printer 

10 engine according to electrophotography, or an engine 
according to another printing scheme. 

The image processing apparatus having the above 
arrangement can take various forms as an apparatus. 
More specifically, the apparatus can be built as, e.g., 

15 a stand-alone copying machine by removing the 

communication interface and LAN interface from the 
above arrangement and integrating the display, keyboard, 
and mouse as an operation panel. Alternatively, the 
apparatus can be built as a stand-alone facsimile 

20 apparatus when the LAN interface is removed, the 
display, keyboard, and mouse are integrated as an 
operation panel, and the communication interface is 
used as an interface dedicated to facsimile. When a 
personal computer is employed as a host, and the above 

25 devices are connected as peripheral devices, an image 
processing system can be built. 
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Image processing to be described below is mainly 
efficiently implemented as printer driver software in 
the host, which generates image information to be 
output to the printer engine. However, this processing 
5 may be implemented by hardware or software incorporated 
in a copying machine, facsimile apparatus, or printer 
main body. 

Fig. 12 is block diagram showing the 
arrangements of a multiplexing apparatus for 

10 multiplexing additional information with image 

information and printing the image and a separation 
apparatus for reading the image having the multiplexed 
additional information and separating the additional 
information, respectively, using the system shown in 

15 Fig. 11. Fig. 12 shows the arrangement of the 
multiplexing apparatus, and Fig. 12 shows the 
arrangement of the separation apparatus. 

Considering the correspondence to Fig. 11, the 
multiplexing apparatus comprises the host 100, display 

20 140, keyboard 160, and mouse 170, and the separation 

apparatus comprises the host 100, scanner 110, display 
140, keyboard 160, and mouse 170. The multiplexing 
apparatus and separation apparatus may be separate 
apparatuses located at remote sites. 

25 Referring to Fig. 12, a quantization condition 

determination section 101 determines a quantization 
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condition used for quantization processing of a pixel 
of interest on the basis of conditions such as image 
information around the pixel of interest, the code of 
additional information, the resolution of a target 
5 scanner apparatus, and the code attachment position. A 
quantization section 102 converts input image 
information into quantization levels smaller in number 
than the input gray levels by pseudo-halftoning 
processing and two-dimensionally expresses halftone 
10 using quantization values of a plurality of pixels. 

An input terminal 200 inputs multilevel image 
information, an input terminal 201 inputs additional 
information to be multiplexed with image information, 
an input terminal 202 inputs the read resolution of the 
15 target scanner, an input terminal 203 inputs the 

resolution of the printer 150, and an input terminal 
204 inputs a condition for determining the code 
attachment position in attaching the code to the image. 
The input terminal 204 of the multiplexing apparatus 
20 can have various forms not as an input terminal in the 
literal sense but as an input source used by the 
apparatus user to input information from the host or 
input source used by software for multiplex processing 
to automatically input information. 
25 Multilevel image information input from the input 

terminal 200 can be input through the Internet or LAN 



- 53 - 



or through the scanner 110, or generated in the host 
100. 

Referring to Fig. 12, a code attachment color 
extraction section 103 extracts a color component to 
5 which a code is attached from image information 

obtained by the scanner 110. A code attachment region 
detection section 104 detects a code attachment region 
on the basis of the code attachment color component of 
image information, which is obtained by the code 

10 attachment color extraction section 103, and the code 
attachment position condition. A threshold value 
selection section 105 measures the average pixel value 
in the code attachment region and selects a threshold 
value corresponding to the average pixel value. A 

15 pixel value distribution state detection section 106 

measures a local density at an arbitrary portion in the 
code attachment region, detects the maximum and minimum 
values, and then calculates the difference between the 
maximum value and the minimum value to detect the 

20 distribution state of pixel values. A code 

determination section 107 compares the threshold value 
selected by the threshold value selection section 105 
with the difference in local average pixel value 
calculated by the pixel value distribution state 

25 detection section 106 to determine a code. 

An output terminal 205 outputs additional 



- 54 - 



information separated by the separation apparatus. 

In the system having the above arrangement, the 
multiplexing apparatus records a code attachment 
position condition input from the input terminal 204 in 
5 e.g., the uppermost line or several lines from the 
uppermost portion of a printed image output from the 
printer 150 as a predetermined dot pattern. On the 
other hand, in reading the image recorded by the 
multiplexing apparatus, the separation apparatus reads 

10 the dot pattern recorded in the uppermost line or 

several lines from the uppermost portion of the image 
and extracts the code attachment position condition. 

If the multiplexing apparatus and separation 
apparatus handle an image having a predetermined format 

15 and software for handling that format is executed in 
each apparatus, the above-described dot pattern 
recording and reading can be omitted by setting the 
code attachment position condition in the software in 
advance . 

20 If the code attachment position condition set by 

the multiplexing apparatus can be known on the 
separation apparatus side, the condition may be input 
by the apparatus user using the host on the separation 
apparatus side. If the two apparatuses are connected 

25 through a network, the condition may be input through 
the network. 



As described above, the code attachment position 
condition input terminal 204 on the separation 
apparatus side is not an input terminal in the literal 
sense but can have various forms. 
5 Code attachment processing (additional 

information multiplex processing) executed by the 
multiplexing apparatus shown in Fig. 12 when two 
quantization values are used, and the print resolution 
of an image is equal to the read resolution will be 
10 described next with reference to the flow chart shown 
in Fig. 13. 

Assume that as a color component used for code 
attachment, a color most unnoticeable is selected. For 
example, if the printer prints using four inks: cyan 

15 (C) , magenta (M) , yellow (Y) , and black (Bk) , a code is 
attached to the Y component that is most unnoticeable. 
The code attachment can be implemented by changing the 
quantization result by changing the quantization 
condition in error diffusion. Hence, in this 

20 embodiment as well, code attachment to image 

information is done by changing the quantization 
condition in pseudo-halftoning processing, and the size 
of image information is m x n pixels. 

First, in step S200, variables (i) and (j) for 

25 counting addresses in the vertical direction (i (row) 
direction) and horizontal direction (j (column) 
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direction) of an image are initialized to "0". In step 
S201, it is checked whether the address value indicated 
by the address variable (i) in the vertical direction 
represents a row to which a code is to be attached. In 
5 step S202, it is checked whether the address value 

indicated by the address variable (j) in the horizontal 
direction represents a column to which a code is to be 
attached. 

If YES in steps S201 and S202, the flow advances 

10 to step S203 to calculate the code counter value (n) 
from the coordinate values of the pixel of interest. 
The code counter (n) is a code number counter for 
storing processing contents corresponding to a code 
generated for a plurality of rows. 

15 In step S204, it is checked whether the nth code 

is to be generated for the first time or being 
generated. If the code is to be generated for the 
first time, the flow advances to step S205 to derive 
the quantization condition with reference to the image 

20 information and the code to be attached. In step S206, 
the quantization condition for generation of the nth 
code, which is derived in step S205, is stored, and the 
flow advances to step S207. If it is determined in 
step S204 that the code is being generated, the flow 

25 advances to step S208 to acquire the stored 

quantization condition of the code number (n) , and then, 
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the flow advances to step S207. 

If NO in step S201 or S202, the flow advances to 
step S209 to acquire a normal quantization condition 
without code attachment, and then, the flow advances to 
step S207. 

In step S207, pseudo-halftoning processing is 
executed for the image information. Especially, 
pseudo-halftoning processing in the code attachment 
region will be described later in detail with reference 
to Figs. 15A to 15C. 

In step S210, the count value of the address 
variable (j) in the column direction is incremented by 
one. In step S211, it is checked whether processing in 
the column direction is ended. If processing in the 
column direction is not ended for the same address 
variable (i) , the flow returns to step S202 to repeat 
the above-described processing. If the processing is 
ended, the flow advances to step S212 to initialize the 
address variable (j) in the column direction to "0". 
In step S213, the count value of the address variable 
(i) in the row direction is incremented by one. 

In step S214, it is checked whether processing is 
ended for all rows. If NO in step S214, the flow 
returns to step S201 to repeat the above-described 
processing. If YES in step S214, the flow advances to 
step S215 to record the image information that has 
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undergone pseudo-halftoning processing. 

Multiplexed additional information separation 
processing executed by the separation apparatus having 
the arrangement shown in Fig. 12 will be described with 
5 reference to the flow chart shown in Fig. 14. 

In step S300, the scanner scans a print having a 
printed image to read the image. In step S301, a color 
component to which a code is attached is extracted from 
the image information acquired in step S300. 

10 In step S302, the variables (i) and (j) for 

counting addresses in the vertical direction (i (row) 
direction) and horizontal (j (column) direction) of the 
image information are initialized to "0". In step S303, 
it is checked whether the value indicated by the 

15 address variable (i) represents a row to which a code 
is attached. In step S304, it is checked whether the 
value indicated by the address variable (j) represents 
a column to which a code is attached. If YES in steps 
S303 and S304, the flow advances to step S305. If it 

20 is determined in step S303 or S304 that at least one of 
the address variables (i) and (j) is not an address 
with code attachment, the flow skips steps S305 to S308 
and advances to step S309. 

In step S305, the average pixel value in an 

25 arbitrary local region in the code attachment region is 
measured, and the difference between the maximum value 



- 59 - 



and the minimum value of the local average pixel value 
is calculated. In step S306, the average pixel value 
of the entire code attachment region is measured. In 
step S307, a threshold value used to determine the code 
5 is acquired on the basis of the average pixel value 

obtained in step S306. In step S308, the difference in 
local average pixel value, which is obtained in step 
S305, is compared with the threshold value obtained in 
step S307, thereby determining the code. After that, 
10 the flow advances to step S309. 

In step S309, it is checked whether an 
unseparated code remains. If YES in step S309, the 
flow advances to step S310. If NO in step S309, the 
separation processing is ended. 
15 In step S310, the value of address variable (j) 

is incremented by one. In step S311, it is checked 
whether processing in the column direction is ended. 
If processing in the column direction is not ended for 
the same address variable (i), the flow returns to step 
20 S304 to repeat the above-described processing. If the 
processing is ended, the flow advances to step S312 to 
initialize the address variable (j) in the column 
direction to "0". In step S313, the count value of the 
address variable (i) in the row direction is 
25 incremented by one. 

In step S314, it is checked whether processing 
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for the image information is ended. If NO in step S314, 
the flow returns to step S303 to repeat the 
above-described processing. If YES in step S314, the 
information separation processing is ended. 
5 In the above processing, step S305 may be 

executed after step S306 or S307. If the end of code 
can be detected by checking the information after 
separation processing, processing in step S309 can be 
omitted. 

10 Details of pseudo-halftoning processing in the 

code attachment region will be described next in more 

detail with reference to Figs. 15A to 15C. 

Figs. 15A to 15C are views showing a state 

wherein image data in which one pixel is expressed by 8 
15 bits is binarized using error diffusion, and a code 

representing additional information is multiplexed at 

the time of binarization processing. 

Assume image data having a density of 50% (i.e., 

pixel value "128"), as shown in Fig. 15A. Fig. 15B 
20 shows an image obtained by binarizing the image data 

using error diffusion. Fig. 15C shows an image to 

which a code is attached at the time of binarization. 
The code value is discriminated depending on 

whether a set of identical quantization values that are 
25 artificially generated is present. The artificially 

generated quantization value is determined in 
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accordance with the average density of the image around 
the pixel to which the code is to be attached. When 
the average density of the image is high, a 
quantization value representing the lowest density 
5 (i.e., "0") is selected. When the average density of 
the image is low, a quantization value representing the 
highest density (i.e., "255") is selected. 

Since the image shown in Fig. 15A has an 
intermediate density, either quantization value can be 
10 selected. In this case, however, assume that a 

quantization value representing the lowest density 
("0") is generated. When an inkjet printer or the like 
is used as the printer engine of the printer 150, an 
ink dot spreads on the medium in printing the image on 
15 a printing medium. For this reason, the average 

density around the pixel to which the code is to be 
attached in switching the quantization value selected 
as a code is not always 50%. In other words, the range 
of the pixel for which the quantization value is 
20 artificially generated, as shown in Fig. 15C, is 

determined on the basis of the resolution ratio of the 
printing apparatus to the image reading apparatus. 

The minimum condition for the range for which the 
quantization value should be artificially generated is 
25 resolution 1/2 that of the image reading apparatus 

because of the sampling theorem. When the size of a 
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pixel, which is calculated from the resolution of the 
printing apparatus by the spread of ink on the printing 
medium is different from the size of an ink dot on the 
medium or a blank region without ink, not the 
5 resolution of the printing apparatus but the size of an 
ink dot or blank region may be used. 

In this embodiment, as shown in Fig. 15C, a 
region (set of the identical artificial quantization 
values) 400 having a 3 (horizontal) x 2 (vertical) 
10 image size is generated. At this time, when 

binarization processing is executed using error 
diffusion, the density of image information should be 
stored, and therefore, a region 401 where the density 
is inverted from the artificially generated 
15 quantization value is generated. The density inverted 
region 401 can have various shapes and sizes. Since 
the region 401 is a factor for canceling the density in 
the artificially generated region 400, the size of 
region 401 is affected by the size of region 400 and 
20 becomes large. Each of the regions 400 and 401 is 
formed by identical quantization values. For this 
reason, when a code is attached, regions having low and 
high average densities simultaneously appear 
independently of the average density of the code 
25 attachment region. 

Even when the average density of the image shown 
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in Fig. 15A is changed by changing the average density 
in the code attachment region to change the 
artificially attached quantization values to, e.g., 
"90" or "150", local regions having low and high 
5 densities still simultaneously appear while storing the 
average density in the code attachment region. As a 
consequence, even after printing by the inkjet printer, 
the local low- and high-density regions simultaneously 
appear in the code attachment region. 

10 For an image obtained by the image reading 

apparatus such as a scanner, consider the average pixel 
value in a range corresponding to the artificially 
generated region 400 in the code attachment region. 
The difference in average pixel value between pixels 

15 including the region 400 and those including the region 
401 becomes large. 

On the other hand, as shown in Fig. 15C, when a 
region as a set of identical quantization values that 
are artificially generated is not generated, the 

20 identical quantization values are distributed due to 
the characteristics of error diffusion. For this 
reason, the average pixel value in the range 
corresponding to the code attachment region is almost 
the same as that of the original image (Fig. 15A) . 

25 When a code is attached, the regions 400 and 401 
locally have the maximum average pixel value and 
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minimum average pixel value, respectively, in the code 
attachment region. Hence, when the average pixel value 
in the range corresponding to the size of code to be 
artificially generated in the code attachment region is 
checked, and the difference between the maximum value 
and the minimum value of the average pixel value is 
compared with the threshold value, the value of code 
can be determined. 

Since the pixel value distribution state changes 
depending on the average pixel value in the code 
attachment region, the threshold value changes 
depending on the average pixel value. Hence, the 
threshold value is measured in advance in units of 
densities by experiments. When the size of region 400 
is set in consideration of not only the resolution 
ratio of the printing apparatus to the image reading 
apparatus but also a condition that the region 401 can 
be detected by the image reading apparatus, the 
detection accuracy improves. 

At an edge portion of an image where the density 
abruptly changes, identical quantization values may not 
be distributed even when the code is not artificially 
attached. Hence, image processing may be performed at 
the edge portion to forcibly distribute the identical 
quantization values. 

According to the above-described embodiment, a 
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code is attached in consideration of the read 
resolution of the apparatus for reading the printed 
image, using a minimum and necessary pixel set in the 
reading apparatus. For this reason, the additional 
5 information can be reliably read from the printed image 
In addition, degradation in image quality upon code 
attachment can be minimized. 

Fig. 16 is a block diagram showing the 
arrangement of a multiplexing apparatus according to 

10 still another embodiment, which multiplexes additional 
information with image information and prints the image 
The same reference numerals as in the above-descried 
embodiment denote the same components in Fig. 16, and a 
detailed description thereof will be omitted. 

15 As is apparent from comparison of components 

between Fig. 16 and Fig. 12, in the above-described 
embodiment, a code is expressed by generating a set of 
pixels having identical quantization values in a 
pseudo-halftone image obtained by quantizing one color 

20 component of image information. In this embodiment, 

however, a code is expressed by a color component for 
which a set of pixels having identical quantization 
values is artificially generated. 

In this embodiment, if a value (bit) to be 

25 embedded is "0", it is embedded in the yellow component 
If the value to be embedded is "1", it is embedded in 
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the magenta component. However, the color component as 
an embedding target is preferably a component that can 
hardly be perceived with a human eye. 

The arrangement of the apparatus shown in Fig. 16 
is different from that of the above embodiment in that 
a color component detection section 108 detects, from 
image information, a color component for which 
processing is in progress, and a quantization condition 
determination section 101a determines the quantization 
value in consideration of the output result from the 
color component detection section 108, i.e., a section 
for determining matching between the state (0 or 1) of 
the bit to be embedded and the color component as an 
embedding target is added. 

Multiplex processing of a code representing 
additional information according to this embodiment 
will be described next with reference to the flow chart 
shown in Fig. 17. The same step numbers as in Fig. 13 
denote the same processing steps in Fig. 17, or 
corresponding steps are not illustrated in Fig. 17. 
Especially, steps S200 and S201, S207, and S210 to S215 
are not illustrated. 

According to the flow chart shown in Fig. 17, 
after steps S200 to S203, it is checked in step S600 
whether the color component that is currently being 
processed is a color component used for code expression. 
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If YES in step S600, the flow advances to step S601. 
If NO in step S600, the flow advances to step S209. 

In step S601, it is checked whether, for the code 
(code "0" or "1") to be currently processed, a set of 
5 identical quantization values is to be generated in the 
color component that is currently being processed. If 
YES in step S601, the flow advances to step S204. If 
NO in step S601, the flow advances to step S209. 

From step S204 or S209, the same processing as in 
10 Fig. 13 is executed. 

As described above, according to this embodiment, 
the set of identical quantization values generated in 
the minimum unit area recognizable on the image reading 
apparatus side can be used for both a code "1" and a 
15 code "0". 

Hence, unlike the above-described embodiment in 
which the code is determined on the basis of a set or 
distribution of identical quantization values, an 
ambiguous state hardly occurs, and the code can be more 
20 reliably detected. 

As a characteristic feature of still another 
embodiment to be described below, a target to which 
additional information is attached is an unnoticeable 
region of a certain color component (e.g., yellow 
25 component) . The unnoticeable region will be described. 
In a print printed by a printing apparatus such as an 
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inkjet printer, the perceptibility of code changes 
depending on the manner the neighboring ink dots are 
printed. For example, at a low-density portion of an 
image, the opportunity of ink discharge is supposed to 
5 be low. If information as a code is embedded in this 
portion, and ink is discharged in correspondence with 
the code, the code is noticeable. However, in an 
intermediate-density region, appropriate ink discharge 
is done at the neighboring portion. Hence, even when 

10 information is embedded in this portion, the code is 

relatively unnoticeable . This embodiment exploits this 
fact. That is, the intermediate-density portion of an 
image to be printed is used as a code embedding target. 
More specifically, the quantization condition 

15 determination section shown in Fig. 16 determines, for 
a yellow component derived from an input image, whether 
the average density including the neighboring pixel 
group surrounding the pixel of interest falls within 
the range between two threshold values with which the 

20 intermediate density is determined. If the average 

value falls within that range, the region is determined 
as an intermediate-density portion and determined as a 
code embedding target. 

When the average density around the pixel of 

25 interest is the intermediate density not for a certain 
color component but for another color component, the 
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color component as a code embedding target may be 
changed to embed the code in the intermediate-density 
region. Even when it is determined that all color 
components do not have the intermediate density, the 
code can be embedded in a color component whose average 
density around the pixel of interest is closest to the 
intermediate density. 

As a result, according to this embodiment, a code 
can be unnoticeably attached, and consequently, 
degradation in image quality can be minimized. 

Fig. 18 is a block diagram showing the main part 
of still another embodiment. In this embodiment, when 
a plurality of types of additional information are 
input, they are attached to different color components 
in units of types. 

Fig. 19 is a view showing a state wherein pieces 
of information of different types are attached to color 
components of an input image, respectively. Referring 
to Fig. 19, voice information is attached to a cyan (C) 
component 901 of an input image information 900, 
character information is attached to a magenta (M) 
component 902 of the input image information 900, and 
copyright information is attached to a yellow (Y) 
component 903 of the input image information 900. By 
printing processing of synthesizing the pieces of color 
component information 901, 902, and 903 having 



multiplexed additional information, image information 
(output image) 904 is obtained. 

Multiplex processing of a code representing 
additional information according to this embodiment 
5 will be described next with reference to the flow chart 
shown in Fig. 20. The same step numbers as in Fig. 13 
denote the same processing steps in Fig. 20, or 
corresponding steps are not illustrated in Fig. 20. 
Especially, steps S200 and S201, S207, and S210 to S215 

10 are not illustrated. 

According to the flow chart shown in Fig. 20, 
after steps S200 to S203, in step S800, a plurality of 
input additional information are classified in units of 
color components to which the pieces of additional 

15 information are to be attached. In step S801, on the 
basis of the result in step S800, a color component 
that is currently being processed is input, and it is 
checked whether it is a color component to which the 
classified information is to be attached, if YES in 

20 step S801, the flow advances to step S204. If NO in 
step S801, the flow advances to step S209. 

From step S204 or S209, the same processing as in 
Fig. 13 is executed. Processing in step S800 may be 
executed before step S203. 

25 As described above, according to this embodiment, 

a plurality of types of information can be attached to 
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one image information. In addition, since image 
processing needed for only a color component to which 
the information is to be attached, efficient processing 
is possible. The color components to which codes are 
attached and additional information are not limited to 
the example shown in Fig. 19, and any other combination 
can be used. In addition, pieces of information of the 
same type (e.g., character information) and having 
different contents can be attached to different color 
components . 

As an embedding target for information to be 
attached, the above-described embodiment may be used. 

In this embodiment, additional information 
multiplex processing is executed using an apparatus 
having the same arrangement as that of the above 
embodiment shown in Fig. 11. However, systematic 
dithering is used for pseudo-halftoning expression, 
unlike the above embodiment in which error diffusion is 
used for the pseudo-halftoning expression. 

When error diffusion is used for the 
pseudo-halftoning expression, and, for example, a 
region 400 is artificially generated, as shown in 
Fig. 15C, a region 401 is naturally formed upon 
distributing the accumulated error. When systematic 
dithering is used, a threshold value matrix must be 
prepared such that regions including continuous pixels 



with two types of identical quantization values are 
generated in code attachment. 

Figs. 21A and 21B are views showing a dither 
matrix and an image having multiplexed additional 
information and binarized by dithering, respectively. 
Fig. 21A shows a threshold value matrix of systematic 
dithering in code attachment. Fig. 21B shows an image 
binarized using the dither matrix shown in Fig. 21A. 

In the dither matrix shown in Fig. 21A, the 
threshold value "X" is made large to always obtain a 
binarization result "0", and the threshold value "Y" is 
made small to always obtain a binarization result "1". 
When binarization processing is executed using such a 
matrix, regions 1000 and 1001 having inverted densities 
and formed from a plurality of pixels with identical 
quantization values can be artificially generated, as 
shown in Fig. 21B. 

When a code is expressed by the presence/absence 
of a combination of regions having inverted densities 
and formed from a plurality of pixels with identical 
quantization values, and the regions 1000 and 1001 are 
not attached, a threshold value matrix that forcibly 
prevents identical quantization values from being set 
over a plurality of pixels is used. 

According to the above-described embodiment, 
since dithering is used for the pseudo-halftoning 
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expression, processing such as error distribution is 
unnecessary, and code attachment can be done by 
high-speed processing as compared to error diffusion, 
and additionally, a code can be reliably attached 
5 regardless of the pixel value state in the code 
attachment region. 

The dithering used in this embodiment can be 
applied to the above-described embodiments. 

As has been described above, according to the 
10 present invention, in multiplexing additional 

information with image information, multiplexing is 
performed using a minimum pixel set readable by the 
image reading apparatus in consideration of the 
resolutions of the image output apparatus and image 
15 reading apparatus. Hence, in reading an image having 

multiplexed information by the image reading apparatus, 
even when the reading apparatus is a popular 
low-resolution scanner, the additional information can 
be reliably separated and read. In addition, 
20 degradation in image quality according to multiplexing 
can be minimized. 

When predetermined information is adaptively 
attached on the basis of the resolution at which the 
output image can be reliably read, the additional 
25 information can be reliably read. 

Since a plurality of different additional 
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information can be attached to different color 
components of an image signal, a plurality of types of 
information can be attached to one image information. 
Fig. 22 is a block diagram showing the 
5 arrangement of an image processing apparatus according 
to still another embodiment, which can be applied to a 
printing apparatus such as an inkjet printer for 
forming an image using pseudo-halftoning expression. 
Referring to Fig. 22, an input terminal 100 

10 inputs image information, and an input terminal 101 
inputs additional information such as identification 
information to be attached to image information. A 
quantization condition determination section 102 
determines a quantization condition for quantization of 

15 image information. A code pattern memory 103 holds dot 
patterns each forming a row component of a code that 
expresses additional information. A pattern number 
lookup memory 104 is used to select a dot pattern to be 
used from the dot patterns held in the code pattern 

20 memory 103. A quantization processing section 105 
quantizes image information using, e.g., error 
diffusion on the basis of the quantization condition 
determined by the quantization condition determination 
section. An output terminal 106 outputs quantized 

25 image information. 

Figs. 23A to 23D are views showing dot patterns 



- 75 - 



held in the code pattern memory 103. Each of the dot 
patterns shown in Figs. 23A to 23D forms a row 
component of a code that expresses additional 
information. The dot patterns shown in Figs. 23A to 
5 23D are combined to form, e.g., a code shown in 

Fig. 24A, 24B, or 24C. For example, when the code is 
embedded in a predetermined region of an image, it 
represents "1". When no code is embedded, it 
represents "0". 
10 As a method of generating each dot of the dot 

patterns shown in Figs. 23A to 23D, for example, when a 
code is to be attached in pseudo-halftoning processing 
using error diffusion, the threshold value is made 
smaller such that the sum of the pixel value of the 
15 pixel of interest and quantization errors distributed 
from the neighboring pixels becomes equal to or larger 
than the threshold value in a pixel whose dot is to be 
turned on. On the other hand, for a pixel whose dot is 
not turned on, a normal threshold value is set to 
20 perform normal error diffusion. 

In this embodiment, the range where the dot 
pattern is attached as a code, as shown in Figs. 24A to 
24C, has a size of 7 x 7 pixels. However, the present 
invention is not limited to this. 
25 Fig. 25 is a flow chart showing the code 

attachment control procedure of this embodiment. The 
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size of an input image is M pixels (in the row 
direction) x N pixels (in the column direction) . 

First, in step S500, a variable i for counting 
the row address and a variable j for counting the 
column address are initialized. In step S501, it is 
determined whether code attachment is to be executed 
for a row indicated by the row address i. If YES in 
step S501, it is determined in step S502 whether code 
attachment is to be executed for a column indicated by 
the column address j . 

If it is determined in steps S501 and S502 that e 
pixel of interest indicated by the addresses i and j i: 
a code attachment position, the flow advances to step 
S503. 

In step S503, it is determined whether the code 
to be generated is a new code. If YES in step S503, 
the flow advances to step S504 to calculate an average 
density d of a row portion (for example, a range 
corresponding to 1 x 7 pixels of row X in the range of 
7x7 pixels shown in Fig. 24C) for which processing i 
in progress within the code region that is currently 
being generated. Then, the flow advances to step S505 

If NO in step S503, the flow advances to step 
S507. In step S507, it is determined whether a dot 
pattern p to be used in the row for which processing i 
in progress within the code region that is currently 



being generated has been determined. If NO in step 
S507, the flow advances to step S505. If YES in step 
S507, the flow advances to step S506. 

In step S505, the dot pattern p to be used is 
5 determined on the basis of the row address i and the 
average density d calculated from part of the code 
region that is currently being generated, and the flow 
advances to step S506. 

In step S506, the quantization condition is 
10 determined on the basis of the dot pattern p and the 
column address j , and the flow advances to step S508. 
If NO in step S501 or S502, the flow advances to step 
S50 9 to set the normal quantization condition, and the 
flow advances to step S508. 
15 After pseudo-halftoning processing is performed 

in step S508, the count value j of column address is 
incremented by one in step S510. In step S511, it is 
determined whether the j of column address exceeds the 
column-direction size of the image. If NO in step S511, 
20 the flow returns to step S502. If YES in step S511, 
the flow advances to step S512. 

After the count value j of column address is 
initialized in step S512, the count value i of row 
address is incremented by one in step S513, and the 
25 flow advances to step S514 . In step S514, it is 

determined whether the i of row address exceeds the 
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row-direction size of the image. If NO in step S514, 
the flow returns to step S501. If YES in step S514, 
the processing is ended. 

As described above, according to this embodiment, 
by combining dot patterns in units of rows and 
attaching them as a code, many types of codes can be 
generated while suppressing an increase in number of 
program codes, hardware configuration, or memory 
capacity. 

The image density used to determine the code is 
detected for only a row where a code is generated for 
the first time. This is effective because almost the 
same image density is detected for the remaining rows 
when detection at an image flat portion is important. 

In the above embodiment, a dot pattern to be used 
is determined using the density of a row in the code 
region, where a code is generated for the first time. 
If the density of the row where density detection has 
been executed is largely different from the average 
density in the remaining rows in the code region, the 
image quality may greatly degrade, or code detection 
may be impossible. 

Figs. 26A to 26F are views for explaining a code 
for high density and a code for low density. 

Figs. 2 6A and 26D show original images. Assume 
the codes shown in Figs. 24A to 24C are generated for 



the images shown in Figs. 2 6A and 2 6D. A dot pattern 
of the code shown in Fig. 24A is a pattern for high 
density because the dot interval is small. Conversely, 
a dot pattern of the code shown in Fig. 24C is a 
5 pattern for low density because the dot interval is 
larger than that in Fig. 24A. 

Referring to Fig. 26A, when only the first code 
generation row has high density, and the remaining rows 
have low density, the density becomes low as a whole. 

10 Hence, the code shown in Fig. 24C is preferably 

attached, as shown in Fig. 26B. However, when the 
pattern is determined using the density of the first 
code generation row, the code shown in Fig. 24A, i.e., 
the pattern for high density is selected, as shown in 

15 Fig. 26C, resulting in large degradation in image 
quality. 

Referring to Fig. 26D, when only the first code 
generation row has low density, and the remaining rows 
have high density, the density becomes high as a whole. 

20 Hence, the code shown in Fig. 24A is preferably 

selected, as shown in Fig. 26E. However, when the 
pattern is determined using the density of the first 
code generation row, the code shown in Fig. 24C is 
selected, as shown in Fig. 26F. Since the code is 

25 hidden by other dots and can hardly be detected. 

This embodiment is different from the above 
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embodiment in the method of selecting a dot pattern in 
each code generation row. In this embodiment, a dot 
pattern to be used in the current row is determined on 
the basis of the average density in the code generation 
5 region of each row and information of a dot pattern 
used in the previous row within the same code. 

Fig. 27 is a view showing a dot pattern selection 
procedure of this embodiment. The code generated in 
Fig. 27 is determined by combining the dot patterns 
10 shown in Figs. 23A to 23D. In this embodiment, the dot 
patterns and code are not limited to those shown in 
Figs. 23A to 23D and Fig. 27, and various dot patterns 
and codes can be used. Referring to Fig. 27, the 0th 
row represents the first code generation row. 
15 Referring to Fig. 27, when the average density in the 

code attachment region of the 0th row is low, pattern 3 
shown in Fig. 23D is selected. If the average density 
is high, pattern 1 shown in Fig. 23B is selected. When 
pattern 3 is selected for the 0th row, pattern 0 is 
20 selected for all the first to third rows. If the 

fourth row has low density, pattern 0 is selected. If 
the fourth row has high density, pattern 2 is selected. 
The pattern for each row is selected according to the 
same procedure as described above, thereby determining 
25 the code structure. Many types of codes can be 
generated, as shown in Fig. 27. This method is 
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effective to embed 1-bit information that represents 
"1" with the presence of a certain code and "0" with 
the absence of the code. 

An image processing apparatus of this embodiment 
has the same arrangement as that shown in Fig. 22 of 
the above embodiment except the contents of a pattern 
number lookup memory 104. The branch position for 
determining a path in pattern selection, branch 
condition, or patterns to be used are held in the 
pattern number lookup memory 104. 

Fig. 28 is a flow chart showing the code 
attachment control procedure of this embodiment. The 
same step numbers as in Fig. 25 denote the same 
procedures in Fig. 28. The operation procedures in 
steps S500 to S502 are the same as in the above 
embodiment, and a detailed description thereof will be 
omitted. 

If YES in step S502, the flow advances to step 
S800 to determine whether the pattern p to be used in 
the current row has been determined. 

If NO in step S800, the flow advances to step 
S504 to calculate an average density d in the row for 
which processing is in progress in the code generation 
region . 

Next, in step S801, the pattern p to be used in 
the current row and a next path t are determined on the 
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basis of the previous pattern selection path t, count 
value i, and density d. The flow advances to step S506 
to determine the quantization condition from the 
pattern p and count value j . 
5 If YES in step S800, the flow advances to step 

S506 to determine the quantization condition. The 
subsequent procedures are the same as in the above 
embodiment . 

As described above, according to this embodiment, 

10 even when image information can be referred to only in 
units of rows, a code to be generated across a 
plurality of rows can be changed in accordance with the 
image density. As a result, a code with high detection 
rate can be generated while suppressing degradation in 

15 image quality. 

As a characteristic feature of an embodiment to 
be described below, a quantization error generated in 
quantization using error diffusion is used to select 
dot patterns registered in units of rows. 

20 Fig. 29 is a block diagram showing the 

arrangement of an image processing apparatus according 
to this embodiment. The same reference numerals as in 
Fig. 22 denote the same parts in Fig. 29. 
A quantization section 900 performs 

25 pseudo-halftoning processing using error diffusion. A 
quantization error buffer 901 stores an error 
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distributed to the neighbor by error diffusion. A 
quantization condition determination section 902 
determines a pattern to be used on the basis of image 
information, additional information, and quantization 
5 error stored in the quantization error buffer 901 and 
determines the quantization condition by looking up a 
code pattern memory 103. 

Figs. 30A and 30B are views showing errors 
generated upon code attachment in this embodiment. 
10 Figs. 30A and 30B show code attachment rows after 

quantization, to which codes are attached by changing 
the threshold value, and quantization error accumulated 
in a row next to the region where code attachment has 
been executed. 

15 Fig. 30A shows a case wherein dots are attached 

to continuous pixels in a region having low image 
density. Fig. 30B shows a case wherein a small number 
of dots are attached to an image density region where 
the ratio of ON/OFF of dots is almost 1 : 1 as a result 

20 of normal quantization processing. 

Referring to Fig. 30A, since continuous dots are 
forcibly generated for the low-density region, large 
negative quantization error is accumulated in the next 
row. On the other hand, referring to Fig. 30B, since a 

25 small number of dots are generated such that the normal 
quantization result is not affected, the quantization 
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error accumulated in the next row is not so different 
from that of normal processing. In other words, when 
dots in a large size are generated such that the image 
quality readily degrades, large error is generated in 
5 the next row and is hidden in the neighboring dots. 
When dots are generated such that they can hardly be 
discriminated from the neighboring dots, error of 
normal level is generated in the next row. 

When the average of quantization errors 
10 accumulated in the code generation region is checked, 
the influence of the dot pattern generated for the 
previous row on the image can be estimated. A dot 
pattern which rarely degrades the image quality and can 
be discriminated from the neighboring dots is generated 
15 at an appearance frequency slightly higher than that of 
the neighboring dots. When large negative error is 
accumulated in the current row, as shown in Fig. 30A, 
too many dots have been generated for the previous row 
as compared to the density. Hence, in the current row, 
20 a dot pattern is selected such that the dot generation 
ratio becomes lower relative to the density. 
Conversely, when the error accumulated in the current 
row falls within the range of normal level, as shown in 
Fig. 30B, a dot pattern is selected such that the dot 
25 generation ratio becomes higher relative to the density. 
Fig. 31 is a flow chart showing the code 
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attachment control procedure of this embodiment. The 
same step numbers as in Figs. 25 and 28 denote the same 
procedures in Fig. 31. The operation procedures in 
steps S500 to S800 in Fig. 31 are the same as in the 
5 above embodiment . 

In step S800, it is determined whether a pattern 
p to be used has been determined. If NO in step S800, 
the flow advances to step S504. If YES in step S800, 
the flow advances to step S506. 
10 In step S504, the average density d of the 

processing row portion in the code that is currently 
being generated is calculated. 

Next, in step SHOO, an average value e of 
quantization errors distributed to the current code 
15 generation region is calculated. 

In step S1101, the dot pattern p to be used is 
determined on the basis of the count value i of row 
address, average density d, and average value e. The 
operation from step S506 is the same as in Fig. 22. 
20 In this embodiment, the relationship between 

degradation in image quality and the code detection 
rate with respect to the attached dot pattern also 
changes depending on the image resolution, or for an 
inkjet printer, an ink dot size on paper or ink color. 
25 Hence, considering the resolution information, ink dot 
size, or code generation color is also effective in 
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determining a dot pattern. 

As described above, according to this embodiment, 
even when image information can be referred to only in 
units of rows, a code with little degradation in image 
5 quality can be generated as long as only several types 
of dot patterns in units of rows are held. 
Consequently, this is effective because the complex 
relationship between dot patterns forming a code need 
not be held, and the number of program codes, hardware 
10 configuration, or memory use capacity need not be 
increased. 

As a characteristic feature of an embodiment to 
be des'cribed below, when all data bits of a row for 
which quantization processing should be executed are 
15 "0", all quantization results in the processing row are 
nullified . 

In many line printers such as inkjet printers, a 
printer driver executes pseudo-halftoning processing in 
units of rows in the host-side computer, and image 

20 information is sequentially transmitted to the printer 
side from a processed row. For color information, 
processing may be performed in units of ink colors of 
the same row. When all quantization results of the 
processing row are "0", image information may not be 

25 transmitted for the purpose of decreasing the transfer 
information amount or processing information amount, 



thereby representing that all quantization results of 
the processing row are "0". In this case, the average 
image density of the processing row is 0. If dots are 
forcibly generated, the image degrades at high 

5 probability. Assume that code generation processing is 
to be executed for a yellow component in a printer 
having ink colors, cyan, magenta, yellow, and black. 
In a line printer such as an inkjet printer, for a row 
having none of the color, components, a paper feed 

10 operation is performed without performing operations 
related printing, thereby improving the throughput. 
However, when a code is generated in a blank region 
where only the paper feed operation is normally 
performed, a yellow dot is generated. As a consequence, 

15 the printing operation is performed, and the throughput 
becomes low. To suppress the degradation in throughput, 
code attachment must be inhibited for a blank row. 

The arrangement of this embodiment can be 
implemented by adapting it to the output portion of the 

20 quantization section 105 shown in Fig. 22 or 

quantization section 900 shown in Fig. 29. Since this 
embodiment does not depend on the quantization scheme, 
it can be adapted to another quantization method such 
as systematic dithering. 

25 Fig. 32 is a flow chart showing the code 

attachment control procedure of this embodiment. The 
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same step numbers as in Fig. 25 denote the same 
processing operations in Fig. 32, and a detailed 
description thereof will be omitted. 

Referring to Fig. 32, next to step S500, in step 
5 S1200, a count value cnt of the number of pixels in the 
processing row, which have a pixel value "0", is 
initialized. If YES in steps S501 and S502, the flow 
advances to step S1201. 

In step S1201, it is determined whether the pixel 
10 value of the current pixel of interest is 0. If YES in 
step S1201, the count value cnt is incremented by one 
in step S1202, and the flow advances to step S1203. If 
NO in step S1201, the flow directly advances to step 
S1203. 

15 In step S1203, the quantization condition is 

determined. To determine the quantization condition, 
any one of the above embodiments can be used. 
Alternatively, a quantization condition determination 
method other than the above embodiments may be used. 

20 The procedures in steps S508 to 511 are the same 

as those in Fig. 25, and a detailed description thereof 
will be omitted. When it is determined in step S511 
that processing for i rows is ended, the flow advances 
to step S1204. 

25 In step S1204, it is determined whether the 

number of pixels having a pixel value "0" equals the 
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number of pixels in the column direction of the image. 
If YES in step S1204, the flow advances to step S1205 
to nullify all quantization results of the ith row, and 
the flow advances to step S512. 

If NO in step S1204, the flow directly advances 
to step S512. Steps S512 and S513 are executed as in 
Fig. 25. If NO in step S514, the flow returns to step 
S1200. If YES in step S514, the processing is ended. 

When image information is referred to only in 
units of rows, processing is often divisionally 
executed in units of color components even for image 
information of the same row. For this reason, with 
processing for a single row, it cannot be determined 
whether all information bits of other color components 
are 0. Hence, the operation of nullifying all code 
attachment results in the processing row is not 
performed by single row processing. Instead, it is 
also effective to change all code attachment results to 
0 after the output result of each processing row is 
referred to, and when it is determined that a 
processing row is blank. 

As described above, according to this embodiment, 
determination whether the image is an image to which 
information should be attached can be implemented by 
simple processing. In addition, since wasteful image 
information output for an image to which information 



need not be attached can be suppressed, degradation in 
throughput of a printer can be suppressed. 

As a characteristic feature of an embodiment to 
be described below, a code that expresses additional 
information is generated for image information after 
quantization processing. In this embodiment, the 
number of quantization values is 2, and the 
quantization value is 0 or 1 for the descriptive 
convenience. This value represents ON/OFF of a dot in, 
e.g., an inkjet printer. 

Even when the number of quantization values is 
larger than 2, this embodiment can be practiced by 
handling the quantization value as a quantization value 
in, e.g., 256 gray levels. 

Fig. 33 is a block diagram showing the 
arrangement of the image processing apparatus according 
to this embodiment. The same reference numerals as in 
Fig. 22 denote the same parts in Fig. 33. 

A quantization section 1300 expresses image 
information by pseudo-halftoning. An information 
multiplexing section 1301 generates a code that 
expresses additional information by looking up a code 
pattern memory 103 and pattern number lookup memory 104. 
In this embodiment as well, a code pattern 
corresponding to one row is held in the code pattern 
memory 103, as in the above embodiment. The held dot 
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patterns are used in accordance with the method held in 
the pattern number lookup memory 104 . 

Figs. 34A to 34F are views showing the dot 
pattern selection procedure of this embodiment. 
Fig. 34A shows image information around the code 
attachment region. Fig, 34B shows a pattern generated 
in the code attachment region. The pattern shown in 
Fig. 34B is determined by describing it in the pattern 
number lookup memory, as shown in Fig. 34E, in 
correspondence with a code attachment region start row 
pattern shown in Fig. 34D in the code attachment region 
shown in Fig. 34A. 

For example, dot patterns held in the code 
pattern memory are selected, as shown in Fig. 34F. 
Output image information is changed as shown in 
Fig. 34C by exchanging the dot patterns in the code 
attachment region. 

Fig. 35 is a flow chart showing the code 
attachment control procedure of this embodiment. The 
same step numbers as in Fig. 25 denote the same 
processing operations in Fig. 35. In step S500, the 
count values of row and column addresses are 
initialized. In steps S501 and S502, it is determined 
whether code attachment is to be executed for the row 
or column. If NO in step S501 or S502, the flow 
advances to step S510. If YES in steps S501 and S502, 
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the flow advances to step S503. In step S503, it is 
determined whether the code to be generated is a new 
code. If NO in step S503, the flow advances to step 
S507 . 

5 If YES in step S503, the flow advances to step 

S1500 to count a dot count c of the current processing 
row portion in the region of the code to be generated, 
and the flow advances to step S1501. In step S507, it 
is determined whether a dot pattern p to be currently 
10 used has been determined. If NO in step S507, the flow 
advances to step S1501. If YES in step S507, the flow 
advances to step S1502. In step S1501, the dot pattern 
p to be used is determined on the basis of a count 
value i of the row address and the dot count value c. 
15 In step S1502, the output value of the pixel of 

interest is determined on the basis of the dot pattern 
p and a count value j of column address and replaced 
with input image information, and the flow advances to 
step S510. The procedures from step S510 are the same 
20 as in Fig. 25. 

As described above, according to this embodiment, 
even when image information can be referred to only in 
units of rows, a code that expresses additional 
information can be generated regardless of the 
25 pseudo-halftoning processing method. 

An embodiment to be described below is different 
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from the above embodiment in the dot pattern selection 
procedure in each code generation row. In this 
embodiment as well, the number of quantization values 
is 2, and the quantization value is 0 or 1 for the 

5 descriptive convenience. This value represents ON/OFF 
of a dot in, e.g., an ink jet printer. Even when the 
number of quantization values is larger than 2, this 
embodiment can be practiced by handling the 
quantization value as a quantization value in, e.g., 

10 256 gray levels. 

As a characteristic feature of this embodiment, a 
dot pattern to be used in the current row is selected 
on the basis of the number of dots in the code 
generation region of each row and information of dot 

15 patterns used in the previous rows in the same code. 

The arrangement of this embodiment is the same as that 
shown in Fig. 33 of the above embodiment of the present 
invention except the contents of a pattern number 
lookup memory 104. 

20 Fig. 36 is a view showing the pattern generation 

procedure of this embodiment. The pattern generated in 
Fig. 3 6 is determined by combining the row patterns 
shown in Figs. 23A to 23D. In this embodiment, the 
patterns are not limited to those shown in Figs. 23A to 

25 23D and Fig. 36, and for example, various patterns such 
as patterns shown in Figs. 34A to 34F can be used. 
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Referring to Fig. 36, the Oth row represents the first 
code generation row. The procedure shown in Fig. 36 is 
almost the same as that shown in Fig. 27 except the 
following point. Referring to Fig. 27, a branch path 
is determined using the average density of image 
information. Referring to Fig. 36, instead, a branch 
path is determined in accordance with the dot count 
value . 

Fig. 37 is a flow chart showing the code 
attachment control procedure of this embodiment. The 
same step numbers as in Figs. 28 and 35 denote the same 
processing operations in Fig. 37. Referring to Fig. 37, 
the operation before step S800 is the same as in 
Fig. 35. In step S8 00, it is determined whether a dot 
pattern p to be used has been determined. If YES in 
step S800, the flow advances to step S1502. If -NO in 
step S800, the flow advances to step S1700. In step 
S1700, a dot count c in the processing row in the code 
region which is currently being generated is counted. 
In step S1701, the pattern to be used and a next path t 
are determined on the basis of the previous pattern 
selection path t, count value i of the row address, and 
dot count c. The flow advances to step S1502. The 
processing from step S1502 is the same as in Fig. 35. 

As described above, according to this embodiment, 
in an image processing apparatus for processing 
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information in units of rows, a code that expresses 
additional information can be generated independently 
of the pseudo-halftoning processing method. In 
addition, even when image information can be referred 
5 to only in units of rows, a code dot pattern across a 
plurality of rows can be changed in accordance with the 
image information. As a result, a code with high 
detection rate can be generated while suppressing 
degradation in image quality. 
10 An embodiment to be described below is different 

from the above embodiments in the dot pattern selection 
method in each code generation row. In this embodiment 
as well, dot patterns are held in units of rows. As a 
characteristic feature, however, a dot pattern to be 
15 used in the current row is selected using the 

quantization value in the processing row in the code 
generation region before code attachment and the 
difference information between the quantization value 
before code attachment and that in the dot pattern. In 
20 this embodiment as well, the number of quantization 

values is 2, and the quantization value is 0 or 1 for 
the descriptive convenience. This value represents 
ON /OFF of a dot in, e.g., an inkjet printer. Even when 
the number of quantization values is larger than 2, 
25 this embodiment can be practiced by handling the 

quantization value as a quantization value in, e.g., 
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256 gray levels. 

Fig. 38 is a block diagram showing the 
arrangement of an image processing apparatus according 
to this embodiment. The same reference numerals as in 
Fig. 33 denote the same parts in Fig. 38. 

Referring to Fig. 38, in a code pattern memory 
103, dot patterns are registered in units of rows. A 
quantization value difference buffer 1801 stores 
quantization value error generated upon code pattern 
attachment in a row before the row for which processing 
is in progress in the code generation region. An 
information multiplexing section 1800 selects a pattern 
to be used from the dot patterns registered in the code 
pattern memory 103 on the basis of image information 
and quantization value error information stored in the 
quantization value difference buffer 1801. 

The information multiplexing section 1800 also 
calculates the difference value between the number of 
dots of an input image and that in the dot pattern to 
be attached and stores the difference value in the 
quantization value difference buffer 1801. 

Figs. 39A and 39B are views showing the code 
attachment control procedure of this embodiment, in 
which a dot pattern is attached in the previous 
processing row. Fig. 39A shows a case wherein 
continuos dots are attached to a low-density region. 
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Referring to Fig. 39A, in the previous processing row, 
continuos dots are attached although the density is low. 
Hence, in the previous processing row, the difference 
in quantization value between the original image and 
the attached dot pattern becomes large. Since a dot 
pattern different from the distribution of the 
neighboring dots is attached, the neighboring dots and 
the attached pattern can be easily discriminated in 
Fig. 39A. However, from the viewpoint of storage of 
image density, a pattern having dots in number as small 
as possible is preferably selected in the next row. On 
the other hand, referring to Fig. 39B, a pattern whose 
dot ratio is close to the dot appearance rate of the 
original image is attached to a region where the 
original image has an intermediate density. Referring 
to Fig. 39B, since the dot ratio of the original image 
is close to that of the attached pattern, the 
difference in quantization value between the original 
image and the attached dot pattern in the previous 
processing row becomes small. Referring to Fig. 39B, 
since the attached pattern is close to the original 
image, degradation in image quality is small. However, 
this makes it difficult to detect the code. Hence, in 
the next processing row, an additional pattern 
including dots in number larger than the previous 
processing row is selected. 
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Fig. 4 0 is a flow chart showing the code 
attachment control procedure of this embodiment. The 
same step numbers as in Fig. 37 denote the same 
processing operations in Fig. 40. Referring to Fig. 40, 
the operations in steps S500 and S501 are the same as 
in Fig. 37. After that, in step S2000, it is 
determined whether the code to be currently generated 
is a code to be generated for the first time. If YES 
in step S2000, the quantization value difference buffer 
1801 is initialized in step S2001, and then the flow 
advances to step S502. If NO in step S2000, the flow 
directly advances to step S502. The procedures in 
steps S502 to S1700 are the same as in Fig. 27. Next 
to step S1700, in step S2002, a dot pattern p to be 
used is determined on the basis of a counter i of the 
row address, a dot count c, and the value stored in the 
quantization value difference buffer. In step S1502, 
the output value of the pixel of interest is determined 
on the basis of the dot pattern p and a count value j 
of column address, and the flow advances to step S2003. 
In step S2003, the difference between the quantization 
value of the original image of the pixel of interest 
and the output determined in step S1502 is obtained and 
added to the value in the quantization value difference 
buffer. The flow advances to step S510, and the 
procedures from step S510 are the same as in Fig. 27. 
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In this embodiment, the calculated difference of 
quantization value is directly added to the 
quantization value difference buffer in step S2002 
shown in Fig. 40. However, instead of using the 
difference value for processing of the next row, the 
difference value may be multiplied by a weighting 
coefficient to change the distribution ratio. 

The relationship between degradation in image 
quality and the code detectability with respect to the 
attached dot pattern also changes depending on, e.g., 
image resolutions, or for an inkjet printer, ink dot 
sizes on paper or ink colors. Hence, considering the 
resolution information, ink dot size, or code 
generation color is also effective in determining a dot 
pattern. 

As described above, according to this embodiment, 
even when image information can be referred to only in 
units of rows, a code dot pattern with little 
degradation in image quality can be generated 
regardless of the pseudo-halftoning processing method 
as long as only several types of dot patterns in units 
of rows are registered. Consequently, this is 
effective because the complex relationship between dot 
patterns need not be registered, and the number of 
program codes, hardware configuration, or memory 
capacity need not be increased. 
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As a characteristic feature of an embodiment to 
be described below, when all data bits of a row for 
which code attachment processing should be executed are 
"0", all output results in the processing row are 
5 nullified. This embodiment is different from the above 
embodiment in that code generation processing is 
controlled for image information after quantization 
processing . 

The arrangement of this embodiment can be 

10 implemented by adapting it to the output portion of the 
information multiplexing section 1301 shown in Fig. 33 
of the above embodiment or information multiplexing 
section 1800 shown in Fig. 38 of the above embodiment. 

Since this embodiment does not depend on the code 

15 attachment scheme, it can be adapted to another code 
attachment processing for an image after quantization 
processing . 

Fig. 41 is a flow chart showing the code 
attachment control procedure of this embodiment. The 

20 same step numbers as in Fig. 32 denote the same 

processing operations in Fig. 41. Referring to Fig. 41, 
in steps S500 and S1200, initialization processing is 
executed, as in Fig. 32. In steps S501 and S502, it is 
determined whether the row or column is a code 

25 attachment position. If NO in step S501 or S502, flow 
advances to step S510. If YES in steps S501 and S502, 
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the flow advances to step S1201. In step S1201, it is 
determined whether the pixel value of the pixel of 
interest is 0. If YES in step S1201, the flow advances 
to step S1202 to increment a value cnt by one, and the 
flow advances to step S2100. If NO in step S1201, the 
flow directly advances to step S2100. In step S2100, 
processing of determining the dot pattern p and then 
the output value is performed, and the flow advances to 
step S510. Processing in step S2100 is executed by the 
method of the above embodiment, as described above. 
Processing from step S2100 is the same as in Fig. 32. 

As in the above embodiment, for a color image, 
the output results of all color components in the same 
row may be referred to, and then, all the code 
generation results may be nullified. 

As described above, according to this embodiment, 
in code attachment processing of attaching a code to 
image information that has undergone quantization 
processing, when code attachment is unnecessary, 
wasteful dot output can be suppressed. For this reason, 
the influence on the quality of the output image or the 
throughput of, e.g., an inkjet printer can be reduced. 

In the above embodiments, dot patterns are held 
in the code pattern memory 103 shown in Fig. 22 in 
units of rows, like the dot patterns shown in Figs. 23A 
to 23D. For example, dot patterns may be held as shown 
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in Figs. 24A to 24C, and a dot pattern corresponding to 
one row may be generated from the dot patterns shown in 
Figs. 24A to 24C in selecting a dot pattern. 

In the above embodiments, dot patterns are 
determined in units of rows. However, dot patterns 
need not always be selected in units of rows. For 
example, dot patterns may be determined in units of 
smaller regions than the range (the range of 7 x 7 
pixels shown in Figs. 24A to 24C) of attachment of a 
dot pattern representing information, e.g., every two 
rows or in units of columns. 

As has been described above, according to the 
present invention, since the number of dot patterns to 
be generated can be reduced, an increase in the number 
of program codes, hardware configuration, or memory 
capacity can be prevented. 

In addition, since the dot pattern can be 
selectively embedded in units of regions smaller than a 
first dot pattern representing predetermined 
information, degradation in image quality can be 
suppressed, and the predetermined information can be 
detectably embedded. 

Fig. 42 is a schematic block diagram showing the 
arrangement of an image processing apparatus according 
to still another embodiment of the present invention. 
Referring to Fig. 42, an image information supply 
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section 10 supplies image information to be processed, 
to which all arrangements capable of supplying a 
processing image correspond, including a scanner, 
CD-ROM, optical disk, and magnetic disk. 
5 An image input section 20 receives image 

information from various image information supply 
sections 10, separates the information into image 
information and additional information, and supplies 
them to an image quantization section 30. The image 

10 quantization section 30 receives the image information 
and additional information different from the image 
information from the image input section 20 and 
executes multiplex processing. When code attachment is 
executed on the basis of pixel values around the pixel 

15 of interest in image information, the image 

quantization section 30 determines whether decoding is 
possible, determines the quantization condition on the 
basis of the determination result, the pixel values 
around the pixel of interest in image information, and 

20 the additional information to be multiplexed, and 

quantizes the pixel of interest in image information by 
pseudo-halftoning processing under the determined 
quantization condition. 

An image output section 40 outputs the image 

25 information quantized by the image quantization section 
30. The image output section 40 comprises, e.g., a 
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printing apparatus such as an inkjet printer for 
forming an image using the pseudo-halftoning expression. 

The detailed arrangement of the image 
quantization section 30 will be described below with 
5 reference to Fig. 43. Fig. 43 is a block diagram 
showing the detailed arrangement of the image 
quantization section 30 shown in Fig. 42. 

Referring to Fig. 43, an input terminal 100 
inputs image information. An input terminal 101 inputs 
10 additional information such as identification 

information. A decodability determination means 102 
detects the image density in the code attachment region 
and determines whether the attached code is decodable. 
The decodability determination means 102 is referred to 
15 in determining the quantization condition. 

A quantization condition determination means 103 
determines the quantization condition for quantization 
of image information. A quantization means 104 
quantizes the image information. The quantization 
20 means 104 quantizes the image information using, e.g., 
error diffusion under the quantization condition 
determined by the quantization condition determination 
means 103. An output terminal 105 outputs the 
quantized image information. 
25 Error diffusion is a method of expressing, by 

pseudo-halftoning, multilevel image information by 
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using binary values or quantization values smaller than 
the input image information. In this quantization 
method, an error generated upon quantizing a pixel 
value of interest is distributed to pixels around the 
5 pixel of interest, thereby storing the image density. 

An image information processing method according 
to this embodiment having the above arrangement will be 
described below with reference to the flow chart shown 
in Fig. 44. Fig. 44 is a flow chart showing the 

10 operation procedure of the image quantization section 
30 of the embodiment shown in Fig. 43. 

Referring to Fig. 44, initialization processing 
is performed in step S300. Step S300 represents 
initialization of variables (i,j) for counting the 

15 vertical and horizontal addresses. In step S301, it is 
determined on the basis of the address value whether a 
row (i) is a code attachment row. In this case, 
whether the row address (i) indicates a row to which 
code attachment is to be executed is determined. If 

20 YES in step S301, the flow advances to step S302 to 
determine whether a column (j) is a code attachment 
column. Step S302 also represents a determination 
means based on the address value, as in step S301. 
Whether the column address (j) represents a column to 

25 which a code is to be attached is determined. 

If YES in steps S301 and S302, the flow advances 
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to step S303. In step S303, the image density around 
the pixel of interest is detected. In step S304, the 
decodability of a code attached by code attachment is 
determined on the basis of the image density around the 
5 pixel of interest. If YES in step S304, the flow 
advances to step S305 to acquire the quantization 
condition for code attachment. Then, the flow advances 
to step S306. 

If NO in step S301 or S302, or if NO in step S304, 

10 the flow advances to step S307 to acquire the normal 
quantization condition without code attachment. Then, 
the flow advances to step S306. 

In step S306, pseudo-halftoning processing is 
executed for the image information in accordance with 

15 the quantization condition acquired in step S305 or 
S307. In step S308, the column address (j) is 
incremented by one. In step S309, it is determined 
whether the column address (j) exceeds a 

column-direction size "m" of image information, thereby 
20 checking whether processing in the column direction is 
ended. If NO in step S309, the flow returns to step 
S302 to perform quantization processing for the next 
column. 

When the quantization conditions acquired in 
25 steps S305 and S307 are compared, the speed of 

pseudo-halftoning processing executed in step S306 is 
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higher under the quantization condition acquired in 
step S307. 

If YES in step S309, the flow advances to step 
S310. In step S310, the column address j is 
5 initialized. In step S311, the row address (i) is 
incremented by one. In step S312, it is determined 
whether the row address (i) exceeds a row-direction 
size "n" of image information, thereby determining 
whether processing in the row direction is ended. If 
10 NO in step S312, the flow returns to step S301 to 
execute quantization processing for the next row. 

If YES in step S312, the processing is ended. 
An example of attachment of information of a 
different kind to image information in this embodiment 
15 will be described next with reference to Fig. 45. 
Fig. 45 is a view showing an information block 
unnoticeably embedded in image information in this 
embodiment. The information block is a unit of 
information to be attached and is formed from, e.g., 
20 the machine identification number of a printing 

apparatus, which is used for anti-forgery of securities. 

In the information block, codes formed from a 
plurality of dots are laid out in accordance with a 
specific regularity. For anti-forgery, the information 
25 block shown in Fig. 45 is unnoticeably embedded in the 
entire image information. 
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The information block shown in Fig. 4 5 expresses 
information by a code layout in the range whose four 
corners are defined by continuous codes, in which rows 
having codes attached at a predetermined interval in 
5 the vertical direction are present. An information bit 
is expressed depending on whether the number of codes 
in the code attachment row is even or odd. In 
anti-forgery of securities, for which information must 
be reliably detected from an image, the information 

10 block is preferably repeatedly embedded in the entire 
image information. To do this, however, codes must be 
generated for a wide range of the entire image. 

When ink is used for printing, as in an inkjet 
printer, an image is expressed by pseudo-halftoning 

15 processing using binary values or low-level 

quantization values, and then, ink dots corresponding 
to the quantization values are printed. A code 
attached to the printed image is also formed by a set 
of dots. 

20 When liquid ink is used for printing, the ink 

spreads on the printing medium in printing. For this 
reason, an off-dot without ink printing may be 
overwritten on the printed image. Hence, a dot forming 
a code is preferably an on-dot having ink printing. 

25 However, when the image density becomes high in a 

color component for code generation, an on-dot is 
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hidden in image information and becomes undetectable. 
That is, the code is meaningless in a high-density 
region, and consequently, code attachment processing is 
wasteful. When the image density is detected, and code 
5 attachment processing is not performed if the image 
density disables code detection, the processing time 
can be shortened. 

Fig. 4 6 is a view showing information attachment 
according to the image density in code attachment 

10 processing of this embodiment. In the example shown in 
Fig. 46, codes are attached to the entire image 
information. In an image density region where no code 
can be detected, code generation processing is not 
performed, and only normal pseudo-halftoning processing 

15 is executed. 

The information block shown in Fig. 45 or 46 is 
merely an example of the present invention, and the 
present invention is not limited to the above form. 
As described above, according to the above 

20 embodiment of the present invention, code generation is 
controlled in accordance with the image density in the 
code attachment region. If a code attached by code 
attachment can be detected, code attachment is executed. 
If the code is undetectable, code attachment is not 

25 executed. This increases the speed of printing 
processing . 
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A printing apparatus such as an inkjet printer or 
color laser printer prints a color image using C (cyan) , 
M (magenta), Y (yellow), and K (black) inks or toners. 
Even when a code is attached by the same method, the 
5 perceptibility of codes changes depending on printed 
color components. 

For example, when a dot is printed on white paper 
using the K ink, the dot is noticeable. However, a dot 
printed using the Y ink is unnoticeable . hence, when 
10 information such as the machine number of a printing 
apparatus used for printing is to be attached for 
anti-forgery of securities, a code is preferably 
generated using the unnoticeable Y ink. 

When C, M, and Y, which are supposed to be ideal 
15 complementary colors, are mixed, black is obtained. 

Since pure black cannot be obtained by actual inks, K 
ink is often used, though an actual inkjet printer 
still prints color close to K by mixing the C, M, and Y 
inks . 

20 As a result, when a Y component region as a code 

attachment color is extracted by reading the printed 
image with a scanner and separating its colors, a dot 
formed by simultaneously printing the C, M and Y inks 
and that formed by printing only the K ink can hardly 

25 be discriminated. A dot formed by the K ink may be 
determined as a dot printed by the Y ink. 
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Hence, a dot pattern having a shape similar to a 
code may appear in a region without any code formed by 
the code attachment color component, resulting in 
information detection error. Additionally, as 
5 described in the above embodiment, even when the 

density of the code attachment color is low, and it is 
determined that code detection is possible, if the K 
ink component is attached in the same region, the 
density of code attachment color component may become 

10 high in an image obtained by reading a printed image 
with a scanner, and code reading may be impossible. 

In this embodiment, execution of code attachment 
processing is controlled in accordance with the density 
of K ink component of image information in code 

15 attachment processing, thereby preventing meaningless 
code generation. 

The basic arrangement of this embodiment is the 
same as that of the above-described embodiment, and a 
portion different from the above embodiment will be 

20 described. In this embodiment, the operation contents 
of a decodability determination means 102 shown in 
Fig. 43 are different. 

Fig. 47 is a flow chart showing the operation 
procedure of this embodiment. The same step numbers as 

25 in the above-described embodiment shown in Fig. 44 

denote the same processing operations in Fig. 47, and a 
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detailed description thereof will be omitted. 

Referring to Fig. 47, as a part different from 
the embodiment shown in Fig. 44, if it is determined in 
steps S301 and S302 that a row (i) is a row for which 
5 code attachment is to be executed, and a column (j) is 
a column for which code attachment is to be executed, 
the flow advances to not step S303 but step S600 to 
detect the density of K ink component around the pixel 
of interest. Then, the flow advances to step S304. In 

10 step S304, the decodability of a code attached by code 
attachment is determined on the basis of the result 
obtained in step S600. The remaining processing 
contents are the same as in the above embodiment. 
According to this embodiment, since code 

15 attachment is not executed for a region where no code 

can be detected due to the influence of K ink component, 
as described above, efficient processing can be 
performed by omitting wasteful processing. 

An embodiment wherein when an information block 

20 crosses an edge portion of image information, special 
quantization processing is executed will be described 
next . 

When the information block crosses an edge 
portion of image information, at the edge portion of 
25 the image information, the layout of dots that appear 
changes depending on the image densities on the both 
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sides of the edge or steepness of the edge, and various 
layouts are obtained. 

For this reason, a code expressed by a specific 
dot layout may be undetectable due to the influence of 
5 dots around a certain edge. For example, when dots 
forming a code are arranged in a distributed layout, 
the code may be hidden in the dot layout in the image 
information near a blur edge generated in a natural 
image. In addition, when the dots forming a code are 

10 arranged in a concentrated layout, and the code 

attachment region is located on the high-density side 
of the edge, the edge may be unnoticeable . In this 
embodiment, when an edge is present near the code 
attachment region, and decoding may be difficult, 

15 control is performed not to execute code generation, 
thereby omitting wasteful processing and implementing 
efficient processing. 

This embodiment also has the same basic 
arrangement as that of the above-described embodiment 

20 shown in Figs. 42 and 43, and a portion different from 
the above-described embodiment will be described below. 
In this embodiment, the operation contents of a 
decodability determination means 102 shown in Fig. 43 
are different. 

25 Fig. 48 is a flow chart showing the operation 

procedure of this embodiment. The same step numbers as 
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in the above-described embodiment shown in Fig. 44 
denote the same processing operations in Fig. 48, and a 
detailed description thereof will be omitted. 

Referring to Fig. 48, as a part different from 
5 the embodiment shown in Fig. 44, if it is determined in 
steps S301 and S302 that a row (i) is a row for which 
code attachment is to be executed, and a column (j) is 
a column for which code attachment is to be executed, 
the flow advances to not step S303 but step S700 to 

10 check the image state around the pixel of interest and 
detect an edge. Then, the flow advances to step S304. 

In step S304, the decodability of a code attached 
by code attachment is determined on the basis of the 
result obtained in step S700. If YES in step S304, the 

15 flow advances to step S305. If NO in step S304, the 
flow advances to step S307 . The remaining processing 
contents are the same as in the above embodiment. 

Fig. 4 9 is a view showing information attachment 
according to edge detection in code attachment 

20 processing of this embodiment. In the example shown in 
Fig. 4 9, image information is divided into a 
low-density region and intermediate-density region at 
the edge. An information block including the edge 
portion is not generated. 

25 It is also effective to control generation in 

units of codes, as shown in Fig. 4 6 of the 
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above-described embodiment. 

As described above, according to this embodiment, 
when an edge is present near the code attachment region, 
code attachment can be controlled in accordance with 
5 the type of edge. For this reason, efficient code 
attachment can be implemented without wasteful 
processing . 

As has been described above, according to the 
present invention, when information of a different kind 
10 is to be multiplexed with image information expressed 

by pseudo-halftoning, execution of attachment of a code 
representing information is controlled in accordance 
with the image density of code attachment color, 
thereby implementing efficient information attachment 
15 without wasteful processing. 

In addition, when a printing apparatus including 
the K ink is used, execution of code attachment 
processing is controlled in accordance with the density 
of K ink component, thereby implementing efficient 
20 information attachment without wasteful processing. 

Furthermore, execution of code attachment 
processing is controlled in accordance with the type of 
edge in image information, thereby implementing 
efficient information attachment without wasteful 
25 processing. 

Moreover, the detectability of predetermined 
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information attached to image information is determined 
and the predetermined information is attached in 
accordance with the determined detectability , thereby 
implementing efficient information attachment without 
5 wasteful processing. Also, the image quality can be 

prevented from degrading. The attached information can 
be read. 

In an embodiment to be described below, as shown 
in Fig. 50, color conversion processing, various 

10 correction processing operations, and pseudo-halftoning 
processing are executed on a host computer to which a 
printer is connected directly or indirectly through a 
network. An image signal that has undergone the above 
processing operations is transmitted into the printer 

15 main body through a serial or USB cable or the network. 
An additional information superposition section in the 
printer main body superposes additional information on 
the image signal. 

Fig. 53 is a block diagram showing the flow of 

20 processing in the first embodiment. The flow of 

processing will be described below with reference to 
Fig. 53. 

Image data input from the upper end in Fig. 53 is 
converted from RGB 24-bit data (each component: 8 bits) 
25 into CMYK 32-bit data by a color conversion section 502 
Various correction processing operations including 
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gamma correction are executed by a various correction 
section 503. Then, the image data is quantized to 
binary to quarternary values (1 to 2 bits) by a 
pseudo-halftoning processing section 504. 
5 The image data after pseudo-halftoning processing 

is input from the host computer to the printer main 
body through an interface such as a parallel cable. At 
this time, to shorten the data transfer time, the image 
data is compressed. 

10 Generally, a compression processing section 505 

compresses the image data after pseudo-halftoning 
processing using a compression method called PackBits. 
This PackBits is a coding scheme based on Run-Length 
Coding and used in a general printer system because 

15 coding/decoding processing is very simple. As is known, 
the compression ratio of image data compressed by 
PackBits is high for a simple image having many flat 
portions, and low for a more complex image including 
many high-frequency components. 

20 Fig. 54 is a view showing the data format of 

image data after compression processing in this 
embodiment. In this embodiment, prior to image data 
transfer, the total amount [Byte] of image data after 
compression and the horizontal size [Pixel] and 

25 vertical size [Pixel] of the image are transferred to 
the printer main body. 
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Processing by the driver section operating on the 

host computer has been described above. 

In the printer main body, upon receiving the 

compressed data, the total amount [Byte] of image data 

5 after compression and the horizontal size [Pixel] and 

vertical size [Pixel] of the image are input to an 

information area interval calculation processing 

section 506. The image data main body other than the 

above data is input to an expansion processing section 

10 507 and decoded in accordance with the processing 

procedure of PackBits. Using the three input 

parameters, the information area interval calculation 

processing section 506 calculates a data amount R 

[bit/pixel] per pixel given by 

15 R=-^— (1.1) 

_ XxY 

Since the data amount R represents the image data 
compression ratio, the data amount R is used as an 
evaluation amount representing the complexity of image 
data . 

20 Generally, when image data is compressed by 

removing certain redundancy, most images having a small 
average information amount R per pixel, i.e., a high 
compression ratio are simple images including many flat 
portions. Conversely, most images having a large 

25 average information amount R, i.e., a low compression 
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ratio are complex images including many high-frequency 
components . 

Hence, the information area interval calculation 

processing section calculates the information area 

5 interval using 

D = — C+C, (1.2) 
R 0 1 

where and C i are arbitrary constants defined in each 
printer system. Equation (1.2) means that the value D 
is large for an image having a small average 

10 information amount R, i.e., a simple image, and small 
for an image having a large average information amount 
R, i.e., a complex image . 

The value D calculated by the above-described 
method is input to a dot pattern attachment processing 

15 section which attaches a dot pattern onto image 

information decoded by the expansion processing section. 
Dot pattern attachment position information is 
generated by an additional information generation 
section 508. The additional information generation 

20 section converts information to be attached (the 

machine number of printer main body, date and time of 
printing, and printing condition) into a dot pattern 
layout in the information area on the basis of some 
rule. On the basis of this layout, the dot pattern 

25 attachment processing section attaches the dot pattern 
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shown in Fig. 51. Fig. 52 is an enlarged view of the 
dot pattern. Referring to Fig. 52, a pixel indicated 
by a black point represents a pixel (to be referred to 
as an on-dot hereinafter) printed on a printing medium 
5 such as paper using ink or toner. 

Figs. 55A and 55B are views showing the layouts 
of information areas obtained using the method 
described in this embodiment. As shown in Figs. 55A 
and 55B, the information area interval is set to be 

10 larger on a simple image (Fig. 55A) than on a complex 
image (Fig. 55B) using the above method. For this 
reason, the total amount of dot pattern attached can be 
suppressed, and the additional information can be 
superposed with little visual incompatibility. 

15 Fig. 56 is a block diagram showing processing in 

an embodiment to be described below. Each portion will 
be described below with reference to Fig. 56. 

Image data input from the upper end in Fig. 56 is 
input to a degree-of -complexity detection section 802, 

2 0 which measures the complexity of the input image. 

In this embodiment, as an evaluation amount 
representing the complexity of an image, the square-sum 
of high-frequency components obtained by 
frequency-converting the image is used. To 

25 frequency-convert an image, various methods such as 

Fourier transform, wavelet, and subband are available, 
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and any method can be used within the scope of the 
present invention. In this embodiment, a description 
will be made using the most popular discrete cosine 
transform (to be referred to as DCT hereinafter) . 
5 Fig. 57 is a flow chart of processing of the 

degree-of-complexity detection section. In steps S901 
to S903, initial setting of various variables is done. 
R is an evaluation amount representing the complexity, 
and i and j are block numbers to be described later. 

10 In this embodiment, an input image is segmented 

into square blocks each having 8x8 pixels in units of 
RGB components, and in step S904, sequentially loaded 
onto a memory incorporated in the computer that 
executes processing of this embodiment. In this 

15 embodiment, the loaded (i,j)th block is expressed by 
B U '""(x,y), B U ' ]1 (x,y), and B U] '(x,y) in units of RGB 
components. In this case, 0 < x < 7 and 0 < y < 7 are 
satisfied. Fig. 58 is a view showing an example of an 
image (RGB components) segmented into blocks. 

20 Each extracted block is converted into a 

luminance signal value B v "' J (x,y) using a method 
represented by 

B*' i] {x,y) = 0.299 ♦ B r U ' 3 ' (x,y) + 0 . 587 • bJ 1 ' 3 ' (x, y) + 

0. 114 

25 • B^' 3 ' (x,y) (2.1) 

In S906, DCT is executed for the luminance signal 
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value B ' (x,y) obtained by the above equation. The DCT 
processing method is widely known, and a detailed 
description thereof will be omitted. 

When DCT is executed for the luminance value of 8 
X 8 pixels, 64 DCT coefficients F (1,:i '{x,y) are obtained. 
Fig. 59 is a view showing the coefficients 
two-dimensionally arranged in accordance with the 
frequencies. Referring to Fig. 59, a DC component is 
present at the upper left corner, and the remaining 
portion represents AC components. For the AC 
components, the horizontal frequency becomes high from 
the left to the right, and the vertical frequency 
becomes high from the upper side to the lower side. 

In this embodiment, 16 hatched high-frequency 
components in Fig. 59 will be exemplified, and their 
sguare-sum is calculated by 

R = R + Xi:{F (iJ) (x,y)} (2.2) 

j=4 i=4 

The calculation represented by equation (2.2) is 
executed for all blocks (S908 to S911) . 

When the above-described processing is ended for 
all blocks in the image, an average evaluation amount 
[R] per block is calculated in step S912 by 

[R] = ~ (2.3) 

L (X/8)-(Y/8) 

Thus, processing by the degree-of -complexity 
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detection section 802 is ended. 

The calculated average evaluation amount [R] is 

input to an information area interval calculation 

processing section. When the average evaluation amount 

[R] takes a large value, the image is a complex image 

including many high-frequency components. When the 

average evaluation amount [R] takes a value close to 0, 

the image is a simple image including many 

low-frequency components. Hence, as described in the 

above embodiment, the information area interval 

calculation processing section calculates the 

information area interval using 

D = ~C 0 +C l (2-4) 
[R] 0 

where C and C i are arbitrary constants defined in each 
printer system. Equation (2.4) means that the value D 
is large for an image having a small average evaluation 
amount [R] , i.e., a simple image, and small for an 
image having a large average evaluation amount [R] , 
i.e., a complex image . 

The value D calculated by the above-described 
method is input to a dot pattern attachment processing 
section 807. The dot pattern attachment processing 
section 807 attaches a dot pattern to image information 
that has undergone processing by a color conversion 
section 804, various correction section 805, and 
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pseudo-halftoning processing section 806. Dot pattern 
attachment position information is generated by an 
additional information generation section 808. The 
additional information generation section converts 
5 information to be attached (the machine number of 
printer main body, date and time of printing, and 
printing condition) into a dot pattern layout in the 
information area on the basis of some rule. On the 
basis of this layout, the dot pattern attachment 

10 processing section attaches the dot pattern. 

With the processing described in this embodiment, 
the information area layout shown in Fig. 55 can be 
implemented, as in the above embodiment. Hence, the 
additional information can be superposed with little 

15 visual incompatibility. 

In the above embodiment, as the evaluation amount 
representing the degree of complexity of an image, the 
square-sum of high-frequency components obtained upon 
frequency-converting the image is used. 

20 In this embodiment, as in the above-described 

embodiment, the absolute sum of 16 hatched 
high-frequency components shown in Figs. 85A to 85D is 
used as an evaluation amount representing the degree of 
complexity of the image. That is, the absolute sum [R] 

25 of the high-frequency components is given by 
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R = R + S£|F (l ' j) (x,y)| (3.1) 

j=4 i=4 

As in the above embodiment, when processing based 
on the above equation is ended for all blocks in the 
image, the average value per block is obtained by 
5 equation (2.3) . The remaining processing is the same 
as in the above embodiment. 

When the processing described in this embodiment 
is executed, almost the same processing as in the above 
embodiment can be done with a small calculation amount. 

10 As has been described above, according to the 

present invention, in processing of multiplexing some 
additional information with image information, the 
degree of complexity of the target image is detected, 
and the information area is controlled in accordance 

15 with the result, thereby controlling the total amount 
of dot pattern to be attached. Hence, additional 
information can be multiplexed with little visual 
incompatibility. 

Fig. 60 is a block diagram showing the additional 

20 information superposition method of an image processing 
apparatus according to still another embodiment. The 
outline of operation will be described first with 
reference to Fig. 60, and then, each section will be 
described in detail. 

25 Referring to Fig. 60, an input terminal 701 
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inputs multilevel RGB image signals. The input signals 
are converted into CMYK signals by a color conversion 
section 702, subjected to various correction processing 
operations by a various correction processing section 
5 703, and input to a pseudo-halftoning processing 

section 704. The pseudo-halftoning processing section 
7 04 converts the input image signal into quantization 
levels smaller in number than the input gray levels by 
pseudo-halftoning processing and two-dimensionally 

10 expresses halftone using quantization values of a 
plurality of pixels. In this embodiment, for 
pseudo-halftoning processing, any one of existing 
systematic dithering and error diffusion can be used. 
Any scheme can be used assuming that the quantization 

15 values are binary values "0" and "1". When the 

quantization value is "1", a dot (ink or toner) is 
printed on a printing medium such as paper. CMYK 
components after the above-described pseudo-halftoning 
processing will be represented by I (x,y), I (x,y), 

20 I (x,y), and I (x, y) , respectively. 

Fig. 61 is a view showing an image that has 
undergone pseudo-halftoning processing in this 
embodiment. The example in Fig. 61 shows a Y (yellow) 
component I (x,y) . 

25 Additional information generated by an additional 

information generation section 705 shown in Fig. 60 is 
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superposed on the Y component I (x,y) binarized by the 
pseudo-halftoning processing section 704, using a 
predetermined dot pattern by an additional information 
superposition section 706. This processing uses the 
5 feature that the Y component is hard to identify with a 
human eye as compared to the remaining components. As 
information to be attached by the additional 
information superposition section 706, various kinds of 
information are available, including the output device 

10 manufacturer name, model name, machine number, and 
output condition in outputting the image to paper. 
These signals are encrypted, as needed, and superposed. 

After the above processing, the CMYK components 
are output to a printer engine 707. Consequently, an 

15 output image having various kinds of information 
superposed can be obtained. 

The outline of operation of the image processing 
apparatus according to this embodiment has been 
described above. Each of the above-described sections 

20 will be described below in detail. First, the 

additional information generation section 705 will be 
described . 

As a general method of superposing additional 
information on an image, matrix points present at an 
25 N-pixel interval in a printable region are defined, as 
shown in Fig. 62, and additional information is 
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expressed depending on whether a dot pattern stored in 
a storage device in a computer or printer main body for 
executing predetermined processing is present at each 
matrix point. 

5 Figs. 63A and 63B are views showing dot patterns 

in this embodiment. Referring to Figs. 63A and 63B, a 
point where a dot (ink to toner) is printed on paper is 
indicated by a black point. In this embodiment, two 
dot patterns are prepared for high- and low-density 

10 regions, as shown in Figs. 63A and 63B, and selectively 
used in accordance with the density around the 
attachment position. In addition, since the origin of 
the coordinate axes is set at the center of each of the 
dot patterns shown in Figs. 63A and 63B, data such as a 

15 pixel count C of the dot pattern, and pixel positions 
( p lx ' p ly ) anc * (Pj'Pj) as snown i- n tne tables shown in 
Figs. 63A and 63B are stored in advance in the storage 
device present in the computer or printer main body for 
performing processing. 

20 When the number of dots per unit area in the dot 

pattern shown in Fig, 63A is compared with that in the 
dot pattern shown in Fig. 63B, the number of dots is 
larger in the dot pattern shown in Fig. 63B. In other 
words, the basic unit formed from a plurality of dots 

25 (5x5 pixels in Fig. 63A, and 3x3 pixels in 

Fig. 63B) is smaller in Fig. 63B. That is, the density 
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of the dot pattern forming the basic unit is higher in 
Fig. 63B. 

The additional information generation section 705 
obtains a position where the above-described dot 
5 pattern is to be attached, using, e.g., a means for 
converting information (e.g., the machine number of 
printer) to be superposed on the basis of some rule. 
Various rules can be used for conversion to position 
information. For example, the machine number or model 

10 name of the printer main body is expressed by a binary 
sequence, and bits "1" and "0" are expressed by the 
presence and absence of dot pattern, respectively. In 
this embodiment, any method can be used. The pieces of 
obtained attachment position information are expressed 

15 by the matrix point interval N and the coordinates 
(L , L ) of Z matrix points where the pieces of 
information are to be attached, as shown in the table 
of Fig. 62, and input to the additional information 
superposition section 706. The additional information 

20 generation section 705 has been described above. 

Additional information attachment processing by 
the additional information superposition section 706 
will be described next. Fig. 64 is a flow chart 
showing additional information superposition processing 

25 in this embodiment. First, in step S1101, the two dot 
pattern data shown in the tables in Figs. 63A and 63B 
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are loaded. In step S1102, each attachment position 
information generated by the additional information 
generation section 705 is loaded. 

From step S1103, the dot patterns are attached to 
5 I (x,y) using these pieces of information. First, in 
step S1103, to grasp the density state around an 
attachment position, an S-pixel square block centered 
on the attachment position (L L ) is defined, and a 
pixel count P in that region is calculated. The 

10 above-described region will be referred to as a 

"density reference region" hereinafter. Fig. 65 is a 
view showing a density reference region in this 
embodiment. Referring to Fig. 65, S = 5. The block 
size S characterizing the density reference region is 

15 predetermined and held in the storage device in the 

computer or printer main body for executing processing 
in this embodiment. 

In step S1104, it is determined whether the dot 
pattern is to be switched, using the pixel count P in 

20 the density reference region, which is calculated in 

step S1103. More specifically, a threshold value thres 
predetermined and held in the storage device in the 
computer or printer main body for executing processing 
in this embodiment is used and when the pixel count P 

25 is smaller than the threshold value thres, the 

low-density region dot pattern shown in Fig. 63A is 
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attached. If the pixel count P is equal to or larger 
than the threshold value thres, the high-density region 
dot pattern shown in Fig. 63B is attached. The above 
operation can be expressed by 
5 if (P < thres) 

I y (L x Z + P lx C ,L y Z + P, y C ) =1/ 1 < c < C 

(1.1) 
else 

+ P tx C ,L y Z + Pj) =1, 1 < c < C 

10 (1.2) 

Figs. 67A and 67B are views showing images before 
and after the dot pattern is attached using processing 
in this embodiment. Referring to Figs. 67A and 67B, 
the threshold value thres = 4, as shown in Fig. 66. 

15 The threshold value thres may be either a fixed value 
for each system or freely set by the user in units of 
images. As is apparent from Fig. 67B, a high-density 
region dot pattern is attached to regions A and B 
having high density (large number of pixels) . 

20 With the above-described processing of this 

embodiment, in processing of superposing a dot pattern 
on an image, the dot pattern can be switched in 
accordance with the density state around the attachment 
position by a relatively simple means. Hence, 

25 additional information can be superposed with little 
visual incompatibility, and the dot pattern detection 
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operation in reading additional information can be 
facilitated. 

Still another embodiment of the present invention 
will be described next in detail with reference to the 
5 accompanying drawings . 

In the above-described embodiment, as the output 
result from the pseudo-halftoning processing section 
704 shown in Fig. 60, binary values (0 and 1) are 
assumed as quantization values. In this embodiment, 

10 ternary values (0, 1, and 2) are assumed as 
quantization values. 

Fig. 68 is a view showing an image that has 
undergone pseudo-halftoning processing in this 
embodiment. Referring to Fig. 68, pixels indicated by 

15 density level 1 and density level 2 represent positions 
where dots are printed on paper using ink or toner. A 
pixel indicated by density level 0 represents a 
position where no dot is printed. A pixel indicated by 
density level 2 is printed at a density twice that of 

20 the pixel indicated by density level 1. In this 

embodiment, the same processing as described in the 
above embodiment is executed for a pseudo-halftone 
image quantized to multiple levels (binary or more 
levels) . 

25 Fig. 69 is a flow chart showing additional 

information superposition processing in this embodiment. 
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In step S1601, as in the above-described embodiment, a 
dot pattern predetermined and stored in the storage 
device section of a computer or printer main body for 
executing processing of this embodiment is loaded. 
5 Figs. 70A and 70B and Fig. 71 are views showing 

dot patterns used in this embodiment. In this 
embodiment, the three dot patterns are used, which are 
dot patterns for low-, intermediate-, and high-density 
regions, respectively. 

10 The two dot patterns shown in Figs. 70A and 70B 

are formed from pixels of density level 1. The 
high-density region dot pattern shown in Fig. 71 is 
formed from pixels of density level 2. These dot 
patterns are described by data as shown in the tables 

15 of Figs. 70A, 70B, and 71 and stored in the storage 
device. This embodiment is different from the 
above-described embodiment in that the density level 
for dot pattern attachment is described. Next, in step 
S1602, each position information (L L ) for dot 

20 pattern attachment is loaded. This processing is the 
same as described in the above embodiment . 

From step S1603, the dot patterns are attached to 
I v (x,y) using these pieces of information. First, in 
step S1603, to grasp the density state around an 

25 attachment position, an S-pixel square block centered 
on the attachment position (i/l/) is defined as a 
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density reference region, and a sum D of the densities 
of pixels in that region is calculated, as in the above 
embodiment. Fig. 72 is a view showing the density 
reference region of this embodiment. Referring to 
5 Fig. 72, S = 5, as in the above-described embodiment. 
In steps S1604 and S1605, it is determined 
whether the dot pattern is to be switched, using the 
sum D of densities in the density reference region, 
which is calculated in step S1603. More specifically, 
10 two predetermined threshold values thresl and thres2 
are used, and when the sum D of densities is smaller 
than the threshold value thresl, the low-density region 
dot pattern shown in Fig. 70A is used. If the sum D is 
equal to or larger than the threshold value thresl and 
15 smaller than the threshold value thres2, the 

intermediate-density region dot pattern shown in 
Fig. 70B is used. If the sum D is equal to or larger 
than the threshold value thres2, the high-density 
region dot pattern shown in Fig. 71 is used. The above 
20 operation can be expressed by 
if (D < thresl) 

I (L 2 + P C ,L Z + P C ) =1, 1 < c < C 

y x Ix y ly 

(2.1) 

else if (D < thres2) 

25 I (L z + P C ,L Z + P C ) =1, 1 < c < C 

y x mx y my 

(2.2) 
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else 

I (L z + P C ,L Z + P C ) = 1, 1 < c < C 

y x hx y hy 

(2.3) 

Figs. 74A and 74B are views showing images before 
5 and after the dot pattern is attached using processing 
in this embodiment. Referring to Figs. 74A and 74B, 
the two threshold values are set as thresl = 4 and 
thres2 = 8, as shown in Fig. 73. These threshold 
values may be either fixed values for each system or 

10 freely set by the user in units of images. 

With the above-described processing of this 
embodiment, in processing of superposing a dot pattern 
on an image, the dot pattern can be switched in 
accordance with the density state around the attachment 

15 position by a relatively simple means. Hence, 

additional information can be superposed with little 
visual incompatibility, and the dot pattern detection 
operation in reading additional information can be 
facilitated. 

20 In this embodiment, only three dot patterns have 

been prepared and described for the descriptive 
convenience. However, the present invention is not 
limited to this. Even when the number of types of dot 
patterns increases to four or more, the same processing 

25 as described above can be executed. 

As has been described above, according to the 
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present invention, additional information with little 
visual incompatibility can be superposed on input image 
information and output, and the error rate of dot 
pattern detection can be reduced in reading the 
5 additional information. 

In addition, when dot patterns having different 
densities are selectively attached to image information 
in accordance with the density of the image information, 
the error rate of dot pattern detection can be reduced 
10 in reading the additional information. 

An embodiment of the present invention will be 
described below in detail with reference to the 
accompanying drawings. The following description will 
be made about an image processing apparatus such as an 
15 inkjet printer, thermal transfer printer, or laser 
printer for expressing image information using 
pseudo-halftoning processing. 

The image processing apparatus according to the 
embodiment to be described below is efficiently mainly 
20 incorporated as printer driver software in a computer 
for generating image information to be output to a 
printer engine. However, it is also effective to 
incorporate the image processing apparatus as hardware 
and software in a copying machine, facsimile apparatus, 
25 or printer main body. 

Fig. 75 is a block diagram showing the 
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arrangement of an embodiment of the present invention. 
The outline of this embodiment will be described first 
with reference to Fig. 75, and then, each section will 
be described in detail. 
5 Referring to Fig. 75, an input terminal 1 inputs 

multilevel RGB image signals. These signals are 
converted into CMYK signals by a color conversion 
section 2, subjected to various correction processing 
operations by a various correction processing section 3, 

10 and input to a pseudo-halftoning processing section 4. 

The pseudo-halftoning processing section 4 converts the 
input image signal into quantization levels smaller in 
number than the input gray levels by pseudo-halftoning 
processing and two-dimensionally expresses halftone 

15 using quantization values of a plurality of pixels. 

In this embodiment, for pseudo-halftoning 
processing, any one of existing systematic dithering 
and error diffusion can be used. Any scheme can be 
used assuming that the quantization values are binary 

20 values "0" and "1". When the quantization value is "1", 
a dot {ink or toner) is printed on a printing medium 
such as paper. 

CMYK components after the above-described 
pseudo-halftoning processing will be represented by 

25 I(x,y), I(x,y), I(x,y), and I,(x,y), respectively. 
Figs. 7 6A to 7 6D are views showing CMYK 



- 138 - 



components after pseudo-halftoning processing of this 
embodiment. Fig. 7 6A shows the C (cyan) component 
after pseudo-halftoning processing, Fig. 76B shows the 
M (magenta) component after pseudo-halftoning 
5 processing, Fig. 7 6C shows the K (black) component 

after pseudo-halftoning processing, and Fig. 76D shows 
the Y (yellow) component after pseudo-halftoning 
processing. Referring to Figs. 76A to 76D, the gray 
regions are 3-pixel square regions to which a dot 

10 pattern is to be attached. 

Additional information generated by an additional 
information generation section 5 shown in Fig. 75 is 
superposed on the Y (yellow) component I (x,y) 
binarized by the pseudo-halftoning processing section 4, 

15 using a predetermined dot pattern by an additional 
information superposition section 6. 

This processing uses the feature that the Y 
component is hard to identify with a human eye as 
compared to the remaining components. As information 

20 to be attached by the additional information 

superposition section 6, various kinds of information 
are available, including the output device manufacturer 
name, model name, machine number, and output condition 
in outputting the image to paper. These signals are 

25 encrypted, as needed, and superposed. 

After the above processing, the CMYK components 
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are output to a printer engine 7. Consequently, an 
output image having various kinds of information 
superposed can be obtained. The outline of operation 
of this embodiment has been described above. 
5 Each section will be described below in detail. 

First, the additional information generation section 5 
will be described in detail. As a general method of 
superposing additional information on an image, matrix 
points present at an N-pixel interval in a printable 

10 region are defined, as shown in Fig. 77, and additional 
information is expressed depending on whether a dot 
pattern predetermined and stored in a storage device in 
a computer or printer main body for executing 
processing of this embodiment is present at each matrix 

15 point. 

Fig. 78 is a view showing a dot pattern in this 
embodiment. Referring to Fig. 78, a pixel at which a 
dot is printed on paper using ink or toner is indicated 
by a black point. Since the origin of the coordinate 
20 axes is set at the center of the dot pattern, data such 
as a pixel count C of the dot pattern, and a pixel 
position (P,P) as shown in the table shown in Fig. 78 

x y 

are stored in advance in the storage device present in 
the computer or printer main body for performing 
25 processing. 

The additional information generation section 5 
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converts information (e.g., the machine number of 
printer) to be superposed into position information at 
which the above-described dot pattern is to be attached, 
on the basis of some rule. Various rules can be used 
5 for conversion to position information. For example, 
the machine number or model name of the printer main 
body is expressed by a binary sequence, and bits "1" 
and "0" are expressed by the presence and absence of 
dot pattern, respectively. In this embodiment, any 

10 method can be used. The pieces of obtained attachment 
position information are expressed by a matrix point 
interval N and the coordinates (Lx,Ly) of Z matrix 
points where the pieces of information are to be 
attached, as shown in the table of Fig. 77, and input 

15 to the additional information superposition section 6. 

The additional information generation section 5 
of this embodiment has been described above. 

The operation of the additional information 
superposition section 6 of this embodiment will be 

20 described next with reference to the flow chart shown 
in Fig. 79. 

First, in step SI, dot pattern data shown in the 
table in Fig. 78 is loaded. In step S2, each of the Z 
attachment position information generated by the 
25 additional information generation section 5, to which 
the dot pattern is to be attached, is loaded. 
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From step S3, the dot pattern is attached to the 
Y component Iy(x,y) using these pieces of information. 
First, in step S3, z = 1 is set. In step S4, to grasp 
the density state around the attachment position, an 
S-pixel square block region centered on the attachment 
position (Lx'Ly 2 ) is defined, and pixel counts Pc, Pm, 
Py, and Pk in that region are calculated in units of 
CMYK planes using 

P c = X X 1 ^ • L x + k, N • L y + 1) (1.1) 

k=-Tl=-T 

P m = X X I - (N ' L x + k ' N ' L y + 1] ( 1 • 2 ) 

k=-Tl=-T 

p y = X X X y (N • L x + k, N • L y + 1) (1.3) 
P k = X X T k< N • L x + k, N • L y + 1) (1.4) 

k=-Tl=-T 

In equations (1.1) to (1.4), T = [S/2] . 

The region defined above will be referred to as a 
"density reference region" hereinafter. Figs. 80A to 
80D are views showing density reference regions in this 
embodiment. Fig. 8 OA shows the density reference 
region of C (cyan) component, Fig. 8 OB shows the 
density reference region of M (magenta) component, 
Fig. 80C shows the density reference region of K 
(black) component, and Fig. 8 0D shows the density 
reference region of Y (yellow) component. 

Referring to Figs. 80A to 80D, the block size S 
characterizing the density reference region is set to 
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"3" having the same size as that of the dot pattern. 
This block size S is predetermined and held in the 
storage device in the computer or printer main body for 
executing processing of this embodiment. 

5 In step S5, it is determined whether the dot 

pattern is to be attached, using the calculated pixel 
counts Pc, Pm, Py and Pk in the density reference 
regions. More specifically, when the pixel counts Pc, 
Pm, Py and Pk satisfy equation (1.5) below, it is 

10 determined that no on-dot is present for all of the 

CMYK planes in the current density reference region of 
interest. In this case, the dot pattern is not 
attached to the matrix point coordinates (Lx , Ly ) , and 
the flow advances to step S7 . 

15 Pc = Pm = Py = Pk = 0 

(1.5) 

On the other hand, if NO in step S5, the flow 
advances to step S6 to execute processing of attaching 
the dot pattern to the matrix point coordinates 
20 (Lx z ,Ly z ), and then, the flow advances to step S7 . This 
processing of attaching the dot pattern is expressed by 
Iy(N • Lx' + Px C ,N • Ly' + Py°) 

(1.6) 

In step S7, it is checked whether z = Z, thereby 
25 checking whether additional information superposition 
processing for all of the L positions is ended. If NO 
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in step S7, the flow returns to step S4 to execute 
additional information superposition processing for the 
next attachment position. When additional information 
superposition processing for all image positions is 
5 ended, this processing is ended. 

Figs. 8 1A to 8 ID are views showing images in 
which the dot pattern is unnoticeably embedded using 
the above processing of this embodiment. 

In regions A and B shown in Figs. 81A to 81D, no 
10 on-dot is present in all the CMYK planes. For this 
reason, the dot pattern is not attached. Even when 
such processing is executed, the additional information 
can be decoded because the dot pattern is attached 
every specific period. 
15 As described above, with the processing of this 

embodiment, in processing of superposing a dot pattern 
on an image, whether the dot pattern is to be attached 
can be determined in accordance with the density state 
around the attachment position, and additional 
20 information can be superposed with little visual 
incompatibility. 

In the above-described embodiment, in attaching 
the dot pattern to the Y component to superpose 
additional information on an image, when no pixel is 
25 present around the attachment position in all the CMYK 
components, the dot pattern is not attached. With this 
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processing, the dot pattern can be prevented from 
undesirably becoming noticeable at a portion where no 
dots are printed on a printing medium such as paper at 
all. 

In an embodiment to be described below, as 
another example in which a dot pattern is undesirably 
noticeable, assume a case wherein a yellow dot pattern 
is attached to a region where on-dots are present only 
in the cyan component. The basic arrangement of this 
embodiment is the same as in the above-described 
embodiment shown in Fig. 75, and a detailed description 
thereof will be omitted. Different portions will be 
mainly described below. 

Figs. 82A to 82D are views showing images after 
pseudo-halftoning processing used in this embodiment of 
the present invention. Figs. 82A to 82D show images 
before dot pattern attachment. Fig. 82A shows the C 
(cyan) component after pseudo-halftoning processing, 
Fig. 82B shows the M (magenta) component after 
pseudo-halftoning processing, Fig. 826C shows the K 
(black) component after pseudo-halftoning processing, 
and Fig. 82D shows the Y (yellow) component after 
pseudo-halftoning processing. Referring to Figs. 82A 
to 82D, the gray regions are 3-pixel sguare regions to 
which a dot pattern is to be attached. 

Fig. 83 is a flow chart showing the operation of 



an additional information superposition section 6 
(Fig. 75) of this embodiment. Additional information 
superposition processing of this embodiment will be 
described below in detail with reference to Fig. 83. 

5 Referring to Fig. 83, first, in step S101, dot 

pattern data shown in the table in Fig. 78 is loaded. 
In step S102, each Z attachment position information 
generated by the additional information generation 
section 5, to which the dot pattern is to be attached, 

10 is loaded. From step S103, the dot pattern is attached 
to the Y component Iy(x,y) using such information. 

First, in step S103, to grasp the density state 
around the attachment position, an S-pixel square block 
region centered on the attachment position (Lx Ly ) is 

15 defined, and pixel counts Pm, Py, and Pk in that region 
are calculated in units of MYK planes except the cyan 
component using 

p «n = X X I »> (N " L * + k ' N ' L y + 1] {2 ' 1] 

k=-Tl=-T 

P y = X X T y {N • L x + k ' N • L y + 1} (2 " 2) 

k=-Tl=-T 

20 K = X X • L x + k, N • L y + 1) (2.3) 

k=-Tl=-T 

In equations (2.1) to (2.3), T = [S/2]. 

The region defined above will be referred to as a 
"density reference region" hereinafter. Figs. 84A to 
84D are views showing density reference regions in this 
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embodiment. Fig. 8 4A shows the density reference 
region of C (cyan) component, Fig. 84B shows the 
density reference region of M (magenta) component, 
Fig. 84C shows the density reference region of K 
5 (black) component, and Fig. 84D shows the density 
reference region of Y (yellow) component. 

Referring to Figs. 84A to 84D, the block size S 
characterizing the density reference region is set to 
"3" having the same size as that of the dot pattern. 
10 This block size S is predetermined and held in the 

storage device in the computer or printer main body for 
executing processing of this embodiment. 

In step S104 shown in Fig. 83, it is determined 
whether the dot pattern is to be attached, using the 
15 calculated pixel counts Pm, Py and Pk in the density 
reference regions. More specifically, when the pixel 
counts Pm, Py and Pk satisfy equation (2.4) below, it 
is determined that no on-dot is present for the MYK 
planes except the cyan component in the current density 
20 reference region of interest. The flow advances to 

step S106, and the dot pattern is not attached to the 
matrix point coordinates (Lx , Ly ) . 

Pm = Py = Pk = 0 (2.4) 
On the other hand, if NO in step S104, the flow 
25 advances to step S105 to execute processing of 
attaching the dot pattern to the matrix point 
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coordinates (Lx', Ly') . This processing can be expressed 
by 

Iy(N • Lx z + Px c ,N • Ly z + Py c ) = 1, 1 < c < C 

(2.5) 

5 Then, the flow advances to step S106. 

In step S106, it is checked whether additional 
information superposition processing for all of the L 
positions is ended. If NO in step S106, the flow 
returns to step S103 to execute additional information 
10 superposition processing for the next attachment 

position. When additional information superposition 
processing for all image positions is ended, this 
processing is ended. 

Figs. 85A to 85D are views showing images after 
15 the dot pattern is attached using the above-described 
processing of this embodiment. In a region A, the dot 
pattern is attached in the above-described embodiment. 
However, in this embodiment, no dot pattern is attached. 
Even when such processing is executed, the additional 
20 information can be decoded because the dot pattern is 
attached every specific period. 

As described above, with the processing of this 
embodiment, in processing of superposing a dot pattern 
on an image, whether the dot pattern is to be attached 
25 can be determined in accordance with the density state 
around the attachment position, and additional 
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information can be superposed with little visual 
incompatibility . 

In this embodiment, the dot pattern is not 
attached to a region where on-dots are present for only 
the cyan component. However, the same processing as 
described above can be executed even for the remaining 
components (magenta and black) , and this is also 
incorporated within the scope of the present invention. 

In the above-described embodiment, binary values 
(1 and 0) are assumed as the quantization outputs from 
the pseudo-halftoning processing section 4. However, 
the present invention is not limited to this, and 
multilevel values (e.g., 0, 1, and 2) may be assumed. 
An embodiment of the present invention in which 
multilevel values (e.g., 0, 1, and 2) are assumed as 
quantization outputs from a pseudo-halftoning 
processing section 4 will be described below. 

In this embodiment, when the quantization value 
is "0", no dot is printed on a printing medium such as 
paper. When the value is "1", a dot is printed using a 
light ink. When the value is "2", a dot is printed 
using a dark ink. 

Even when such multilevel values are used, the 
same processing as in the above-described embodiment 
can be executed. More specifically, the values Pc, Pm, 
Py, and Pk obtained by equations (1.1) to (1.4) in the 
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above embodiment are not the pixel counts in the 
density reference region but the sums of quantization 
output values. If these values satisfy equation (1.5), 
it is determined that no on-dot is present on all the 
MYK plane in the current density reference region of 
interest, and the dot pattern is not attached to the 
matrix point coordinates (Lx,Ly). 

Processing of this embodiment has been described 

above . 

In the above-described embodiment, binary values 
(1 and 0) are assumed as the quantization outputs from 
the pseudo-halftoning processing section 4. However, 
the present invention is not limited to this, and 
multilevel values (e.g., 0, 1, and 2) may be assumed. 
An embodiment of the present invention in which 
multilevel values (e.g., 0, 1, and 2) are assumed as 
quantization outputs from a pseudo-halftoning 
processing section 4 will be described below. 

In this embodiment, when the quantization value 
is "0", no dot is printed on a printing medium such as 
paper. When the value is "1", a dot is printed using a 
light ink. When the value is "2", a dot is printed 
using a dark ink. Even when such multilevel values are 
used, the same processing as in the above-described 
embodiment can be executed. More specifically, the 
values Pm, Py, and Pk obtained by equations (2.1) to 
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(2.3) in the above embodiment are not the pixel counts 
in the density reference region but the sums of 
quantization output values. If these values satisfy 
equation (2.4), it is determined that no on-dot is 
present for the MYK components except the cyan 
component in the current density reference region of 
interest, and the dot pattern is not attached to the 
matrix point coordinates (Lx z ,Ly z ) . Processing of this 
embodiment has been described above. 

An embodiment of the present invention will be 
described below in detail with reference to the 
accompanying drawings. 

An image processing apparatus according to this 
embodiment is efficiently mainly incorporated as 
printer driver software or application software in a 
computer for generating image information to be output 
to a printer engine. However, it can also be 
incorporated in a copying machine, facsimile apparatus, 
or printer main body as hardware and software. 

Image information can be expressed by 
pseudo-halftoning processing used by an inkjet printer, 
thermal transfer printer, laser printer, or the like. 

Fig. 8 6 is a block diagram showing the additional 
information attachment superposition method of an image 
processing apparatus according to this embodiment. The 
outline of operation will be described first with 



reference to Fig. 86, and then, each section will be 
described in detail. 

Referring to Fig. 86, an input terminal 201 
inputs multilevel RGB image signals. The input signals 
are converted into CMYK signals by a color conversion 
section 202, subjected to various correction processing 
operations by a various correction processing section 
203, and input to a pseudo-halftoning processing 
section 204. The pseudo-halftoning processing section 
204 converts the input image signal into quantization 
levels smaller in number than the input gray levels by 
pseudo-halftoning processing and two-dimensionally 
expresses halftone using quantization values of a 
plurality of pixels. In this embodiment, for 
pseudo-halftoning processing, any one of existing 
systematic dithering and error diffusion can be used. 
Any scheme can be used assuming that the quantization 
values are binary values "0" and "1". For a pixel (to 
be referred to as an "on-dot" hereinafter) having a 
quantization value "1", a dot (ink or toner) is printed 
on a printing medium such as paper. CMYK components 
after the above-described pseudo-halftoning processing 
will be represented by I c (x,y), I B (x,y), I y (x,y), and 
I (x,y), respectively. 

Additional information generated by an additional 
information generation section 207 is superposed on the 
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Y component I (x,y) binarized by the pseudo-halftoning 
processing section 204, using a predetermined dot 
pattern by an additional information superposition 
section 205. This processing uses the feature that the 

Y component is hard to identify with a human eye as 
compared to the remaining components. As information 
to be attached by the additional information 
superposition section 205, various kinds of information 
are available, including the output device manufacturer 
name, model name, machine number, and output condition 
in outputting the image to paper. These signals are 
encrypted, as needed, and superposed. 

After the above processing, the CMYK components 
are output to a printer engine 206. Consequently, an 
output image having various kinds of information 
superposed can be obtained. 

The outline of operation of the image processing 
apparatus according to this embodiment has been 
described above. Each of the above-described sections 
will be described below in detail. First, the 
additional information generation section 207 will be 
described. 

As a general method of superposing additional 
information on an image, matrix points present at an 
N-pixel interval in a printable region are defined, as 
shown in Fig. 87, and additional information is 
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expressed depending on whether a dot pattern stored in 
a storage device in a computer or printer main body for 
executing predetermined processing is present at each 
matrix point. 

Fig. 88 is a view showing a dot pattern in this 
embodiment. Referring to Fig. 88, a point where a dot 
(ink to toner) is printed on paper is indicated by a 
black point. In addition, since the origin of the 
coordinate axes is set at the center of the dot pattern 
shown in Fig. 88, data such as a pixel count M of the 
dot pattern, and a pixel position (p\p ) as shown in 
the table shown in Fig. 88 are stored in advance in the 
storage device present in the computer or printer main 
body for performing processing. 

The additional information generation section 207 
obtains a position where the above-described dot 
pattern is to be attached, using, e.g., a means for 
converting information (e.g., the machine number of 
printer) to be superposed on the basis of some rule. 
Various rules can be used for conversion to position 
information. For example, the machine number or model 
name of the printer main body is expressed by a binary 
sequence, and bits "1" and "0" are expressed by the 
presence and absence of dot pattern, respectively. In 
this embodiment, any method can be used. The pieces of 
obtained attachment position information are expressed 
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by the matrix point interval N and the coordinates 
(L Z ,L Z ) of Z matrix points where the pieces of 
information are to be attached, as shown in the table 
of Fig. 89, and input to the additional information 
5 superposition section 205. The additional information 
generation section 207 has been described above. 

Additional information attachment processing by 
the additional information superposition section 205 
will be described next. Fig. 90 is a flow chart 

10 showing additional information superposition processing 
in this embodiment. First, in step S601, the 
above-described dot pattern data is loaded. In step 
S602, each attachment position information generated by 
the additional information generation section 207 is 

15 loaded. 

From step S603, the dot pattern is attached to 
I (x,y) using these pieces of information. First, in 
step S603, it is determined for each of the three dots 
of the dot pattern whether a pixel is present in 

20 advance at the pixel position where the dot pattern is 
to be attached. If YES in step S603, it is determined 
that no change in pixel count occurs at the neighboring 
portion. The flow advances to step S606, and no 
processing is executed at all. In step S606, it is 

25 determined whether the dot pattern has been attached in 
correspondence with the pixel count M. If NO in step 
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S606, the flow returns to step S603 to repeat the 
above-described processing. When the dot pattern is 
attached to all the Z positions, the processing is 
ended in step S608. 

If NO in step S603, the flow advances to step 
S604 to determine whether a pixel is present at a 
position adjacent to the new attachment position. If 
YES in step S604, the flow advances to step S605 to 
execute processing (to be referred to as off-dot 
processing hereinafter) of inhibiting to print one of 
the pixels at the neighboring portion to store the 
pixel count. 

If NO in step S604, or when off-dot processing is 
ended in step S605, the flow advances to step S607 to 
attach a new pixel constructing the dot pattern. 

Figs. 91A and 91B are views showing images before 
and after the dot pattern in this embodiment is 
attached. Fig. 91A shows an image before dot pattern 
attachment, and the gray region is a dot pattern 
attachment region. Fig. 91B shows an image after dot 
pattern attachment, and it indicates a pixel which has 
been present in advance and converted into an off-dot 
by the processing in step S605. 

According to the above-described embodiment, in 
processing of unnoticeably embedding a dot pattern on 
an image that has undergone pseudo-halftoning 
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processing to superpose additional information, the 
number of pixels (density) can be maintained to almost 
the same level before and after information attachment 
by a relatively simple means. Hence, additional 
information can be superposed with little visual 
incompatibility. 

Still another embodiment of the present invention 
will be described next in detail with reference to the 
accompanying drawings . 

In the above-described embodiment, as the output 
result from the pseudo-halftoning processing section 
204 shown in Fig. 86, binary values (0 and 1) are 
assumed as quantization values. In this embodiment, 
ternary values (0, 1, and 2) are assumed as 
quantization values. 

Fig. 92 is a view showing an image that has 
undergone pseudo-halftoning processing in this 
embodiment. Referring to Fig. 92, pixels indicated by 
density level 1 and density level 2 represent pixels 
(on-dots) where dots are printed on paper using ink or 
toner. A pixel indicated by density level 0 represents 
a pixel (off-dot) where no dot is printed. A pixel 
indicated by density level 2 is printed at a density 
twice that of the pixel indicated by density level 1. 

In the above-described embodiment, in attaching a 
predetermined dot pattern to a pseudo-halftone image 
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quantized to multiple levels (binary or more levels), 
processing is executed not to change the sum of 
quantization values around the attachment position. 

Fig. 93 is a flow chart showing additional 
information superposition processing in the embodiment 
to be described below. In step S901, as in the 
above-described embodiment, a dot pattern predetermined 
and stored in the storage device section of a computer 
or printer main body for executing processing of this 
embodiment is loaded. 

Fig. 94 is a view showing a dot pattern used in 
this embodiment. In this embodiment, the dot pattern 
is described by data as shown in the table of Fig. 94 
and stored in the storage device. Referring to Fig. 94, 
this embodiment is different from the above-described 
embodiment in that the density level for dot pattern 
attachment is described. 

Next, in step S902 shown in Fig. 93, each 
position information (l/ i/) for dot pattern attachment 
is loaded. This processing is the same as described in 
the above embodiment . 

In step S903, an increase amount AD of density 
upon attaching the above-described dot pattern to the 
Zth matrix point position (L* L*) is calculated by 
AD = M • V - ZI (N • L * + P\ N • i/ + P ') 

(2.1) 
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for k = 1, . . . , M. 

Equation (2.1) means that the difference between 
the sum of density levels of pixels of the dot pattern 
and the sum of pixels which are present in advance at 
the positions of pixels to be attached is calculated to 
obtain the increase amount of density. 

Next, pixels in an amount corresponding to the 
density increase amount AD obtained by equation (2.1) 
are converted into off-dots in the image I^(x,y). For 
this off-dot processing, first, in step S904, the 
density storage region of an S-pixel square block 
centered on the position (N_l/, N_l/) to which the 
above-described dot pattern is to be attached is set, 
as shown in Fig. 95, and a distance T(x',y') from the 
central position to the pixel I y (x',y') present in that 
region is calculated using 

T(x',y') = -f{ (x' - N • L V + (y' -N-lV} 

(2.2) 

Using this result, in step S905, the pixels are 
sequentially converted into off-dots in ascending order 
of the distance T(x',y'). At this time, the pixel 
value converted into an off-dot is subtracted from the 
density increase amount AD. 

AD = AD - I (N * L x 2 + r\ N • L^ Z + R') 

(2.3) 

Next, in step S906, this off-dot processing is 
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repeated until AD < 0 . When off-dot processing is 
ended, the flow advances to step S907 to attach a pixel 
constructing the dot pattern onto the image I y (x,y). 
Until the dot pattern is embedded at all positions in 
step S908, the above-described processing from step 
S903 is repeated. 

Figs. 96A and 96B are views showing images before 
and after off-dot processing in this embodiment. 
Referring to Fig. 96A, it indicates a pixel which will 
be converted into an off-dot by off-dot processing of 
this embodiment. In regions A and B shown in Fig. 9 6A, 
no pixel values are present at positions where the 
pixels of dot pattern are to be attached. Hence, 
equation (2.1) is rewritten to 

AD = 3_2 - 0 = 6 

(2.4) 

From this result, in both the regions A and B, 
pixels corresponding to the density level sum of 6 are 
sequentially converted into off-dots from a position 
close to the center of dot pattern attachment position. 
More specifically, in the region A, three pixels of 
density level 2 are converted into off -dots, and in the 
region B, six pixels of density level 1 are converted 
into off -dots. As a result, the image shown in 
Fig. 96B is obtained. 

According to the above-described embodiment, the 



- 160 - 



sum of density levels can be maintained around the dot 
pattern attachment position, so additional information 
can be superposed with little visual incompatibility. 

Still another embodiment of the present invention 
will be described next in detail with reference to the 
accompanying drawings. 

In the embodiment to be described below as well, 
assume that the quantization output values from a 
pseudo-halftoning processing section 204 are ternary 
values (0, 1, and 2) . 

Fig. 97 is a view showing an image that has 
undergone pseudo-halftoning processing in this 
embodiment. Referring to Fig. 97, pixels indicated by 
density level 1 and density level 2 represent pixels 
(on-dots) where dots are printed on paper using ink or 
toner at high and intermediate densities, respectively. 
A pixel indicated by density level 0 represents a pixel 
(off-dot) where no dot is printed. 

In this embodiment as well, in attaching a 
predetermined dot pattern to a pseudo-halftone image 
quantized to multiple levels (binary or more levels) , 
processing is executed not to change the sum of 
quantization values around the attachment position. 

Fig. 98 is a flow chart showing additional 
information superposition processing in the embodiment 
to be described below. In step S1401, as in the 
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above-described embodiment, a dot pattern predetermined 
and stored in the storage device section of a computer 
or printer main body for executing processing of this 
embodiment is loaded. 

Fig. 99 is a view showing a dot pattern used in 
this embodiment. In this embodiment, the dot pattern 
is described by data as shown in Fig. 100 and stored in 
the storage device. Referring to Fig. 100, note that 
the density level of pixels of the dot pattern is 
described, as in the above embodiment. 

Next, in step S1402 shown in Fig. 98, each 
position information (i/ i/) for dot pattern attachment 
is loaded. This processing is the same as described in 
the above embodiment. For processing of calculating a 
density increase amount AD in step S1403, equation 
(2.1) is used, as described in the above embodiment. 

In step S1405, pixels in an amount corresponding 
to the density increase amount AD obtained by equation 
(2.1) are converted into off-dots in the image I y (x,y). 
For this off-dot processing, as shown in Fig. 101, the 
order of off-dot processing of pixels is determined in 
advance, and the off-dot processing order data is 
described as shown in Fig. 102 and stored in the 
storage device incorporated in the computer or printer 
main body for executing this processing. In converting 
the pixels into off-dots in accordance with the order 
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shown in Fig. 101, the pixel value converted into an 
off-dot is subtracted from the density increase amount 
AD on the basis of equation (3.2). 

AD = AD - I (N • L Z + R\ N • L Z + R k ) 

y x x y y 

(3.2) 

Next, in step S1406, this off-dot processing is 
repeated until AD < 0 . When off-dot processing is 
ended, the flow advances to step S1407 to attach a 
pixel constructing the dot pattern onto the image 
I (x,y). Until the dot pattern is embedded at all 
positions in step S1408, the above-described processing 
from step S1403 is repeated. 

Figs. 103A and 103B are views showing images 
before and after off-dot processing in this embodiment. 

According to the above-described embodiment, the 
sum of density levels can be maintained around the dot 
pattern attachment position, so additional information 
can be superposed with little visual incompatibility. 

As has been described above, according to the 
present invention, in attaching additional information 
having a specific dot pattern onto an image that has 
undergone pseudo-halftoning processing, pixels present 
around the attachment position are converted into 
off-dots, thereby maintaining the density state. Hence, 
additional information can be superposed with little 
visual incompatibility. 
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In addition, information can be attached with 
little visual incompatibility by adjusting the density 
of image information around the additional information 
attachment position in accordance with the density of 
additional information to be attached. 

The present invention may be applied to a system 
constituted by a plurality of devices (e.g., a host 
computer, an interface device, a reader, a printer, and 
the like) or an apparatus comprising a single device 
(e.g., a copying machine, a facsimile apparatus, or the 
like) . 

The present invention can be implemented even by 
supplying a storage medium storing software program 
codes for realizing the functions of the above-described 
embodiments to a system or apparatus, and causing the 
computer (or a CPU or an MPU) of the system or apparatus 
to read out and execute the program codes stored in the 
storage medium. 

In this case, the program codes read out from the 
storage medium realize the functions of the 
above-described embodiments by themselves, and the 
storage medium storing the program codes constitutes the 
present invention. As a storage medium for supplying 
the program codes, a floppy disk, a hard disk, an 
optical disk, a magnetooptical disk, a CD-ROM, a CD-R, a 
magnetic tape, a nonvolatile memory card, a ROM, or the 



- 164 - 



like can be used. 

The functions of the above-described embodiments 
are realized not only when the readout program codes are 
executed by the computer but also when the OS (Operating 
System) running on the computer performs part or all of 
actual processing on the basis of the instructions of 
the program codes. 

The functions of the above-described embodiments 
are also realized when the program codes read out from 
the storage medium are written in the memory of a 
function expansion board inserted into the computer or a 
function expansion unit connected to the computer, and 
the CPU of the function expansion board or function 
expansion unit performs part or all of actual processing 
on the basis of the instructions of the program codes. 

As many apparently widely different embodiments of 
the present invention can be made without departing from 
the spirit and scope thereof, it is to be understood 
that the invention is not limited to the specific 
embodiments thereof except as defined in the appended 
claims . 
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WHAT IS CLAIMED IS: 

1. An image processing method of multiplexing a code 
representing additional information with image 
information, comprising: 
5 a shape setting step of setting code shape 

information on the basis of a feature of the image 
information; 

a quantization condition determination step of 
determining a quantization condition of a pixel of 
10 interest in the image information on the basis of the 
code shape information and the additional information; 
and 

a quantization step of quantizing the pixel of 
interest on the basis of the quantization condition. 
15 2. The method according to claim 1, wherein in said 
quantization step, quantization by pseudo-halftoning 
processing is executed. 

3. The method according to claim 2, wherein in said 
quantization step, quantization by error diffusion is 

20 executed. 

4. The method according to claim 1, whrein the 
feature of the image information is a density at a flat 
portion . 

5. The method according to claim 1, wherein the code 
25 shape information represents a dot pattern. 

6. The method according to claim 5, wherein in said 



- 166 - 



shape setting step, the code shape information is 
selected from a plurality of dot patterns prepared in 
advance . 

7. The method according to claim 6, wherein the 
plurality of dot patterns prepared in advance can 
appear at a flat portion of the image information as a 
quantization result in said quantization step. 

8. The method according to claim 7, wherein in said 
shape setting step, a dot pattern is selected, which 
does not appear as the quantization result in a uniform 
flat image based on an average pixel value around the 
pixel of interest. 

9. The method according to claim 8, wherein in said 
shape setting step, a dot pattern is selected in which 
the number of on- or off-dots in a smaller number has 
the number of dots larger than that of the dot pattern 
which appears in the uniform flat image as the 
quantization result. 

10. The method according to claim 6, further 
comprising a color component detection step of 
detecting a color component of a code attachment target 
in the image information, wherein 

in said shape setting step, the dot pattern is 
selected on the basis of the color component of the 
image information. 

11. The method according to claim 10, wherein in said 
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shape setting step comprises setting a size of the dot 
pattern on is set the basis of the color component. 

12. The method according to claim 6, further 
comprising an edge detection step of detecting an edge 
portion of the image information, wherein 

in said shape setting step, the dot pattern is 
selected on the basis of whether the edge portion is 
contained in pixels around the pixel of interest. 

13. The method according to claim 12, wherein in said 
shape setting step, a first dot pattern is selected 
when the edge portion is not included in the pixels 
around the pixel of interest, and a second dot pattern 
having a denser dot layout than the first dot pattern 
is selected when the edge portion is included. 

14. An image processing apparatus for multiplexing a 
code representing additional information with image 
information, comprising: 

holding means for holding a plurality of code 
shape information; 

quantization condition determination means for 
determining a quantization condition of a pixel of 
interest in the image information on the basis of the 
additional information and the code shape information 
selected from said holding means on the basis of a 
feature of the image information; and 

quantization means for quantizing the pixel of 
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interest on the basis of the quantization condition. 

15. A recording medium which records a program code 

of an image processing method of multiplexing a code 

representing additional information with image 

information, the program code comprising: 

a code of the shape setting step of setting code 

shape information on the basis of a feature of the 

image information; 

a code of the quantization condition 
determination step of determining a quantization 
condition of a pixel of interest in the image 
information on the basis of the code shape information 
and the additional information; and 

a code of the quantization step of quantizing the 
pixel of interest on the basis of the quantization 
condition. 

16. An image processing apparatus for multiplexing 
additional information with image information, 
comprising : 

first input means for inputting the image 
information; 

second input means for inputting the additional 
information; 

quantization means for multiplexing the 
additional information on the image information and 
executing pseudo-halftoning processing so as to express 
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the additional information by a set of minimum number 
of pixels readable by an image reading apparatus in 
consideration of resolution of an image output 
apparatus for outputting the image information as an 
image and resolution of the image reading apparatus for 
reading the image output from the image output 
apparatus; and 

output means for outputting image data processed 
by pseudo-halftoning processing by said quantization 
means . 

17. The apparatus according to claim 16, wherein the 
pseudo-halftoning processing is executed by error 
diffusion. 

18. The apparatus according to claim 16, wherein the 
pseudo-halftoning processing is executed by dithering. 

19. The apparatus according to claim 16, wherein the 
set of pixels which is generated by said quantization 
means to express the additional information is formed 
from continuous pixels having a first quantization 
value, the continuous pixels having the first 
quantization value having a size determined in 
consideration of the resolution of the image reading 
apparatus . 

20. The apparatus according to claim 19, wherein said 
quantization means generates, adjacent to the set of 
continuos pixels having the first quantization value, a 
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set of continuos pixels having a second quantization 
value for compensating a density expressed by the set 
of continuos pixels having the first quantization value 
so as to maintain an average density of image 
information in a neighboring region of pixels on which 
the additional information is to be multiplexed. 

21. The apparatus according to claim 20, wherein the 
additional information multiplexed on the image 
information is expressed by a combination of the set of 
continuous pixels having the first quantization value 
and the set of continuous pixels having the second 
quantization value. 

22. The apparatus according to claim 16, wherein the 
additional information is attached to one of a 
plurality of color components of the image information. 

23. The apparatus according to claim 22, further 
comprising selection means for checking a density of a 
neighboring pixel near an attachment position of the 
additional information in units of the plurality of 
color components and selecting, on the basis of an 
average density of the neighboring pixels, a color 
component hard to visually recognize from the plurality 
of color components as an image information of the 
image information, with which the additional 
information is to be multiplexed. 

24. The apparatus according to claim 22, further 
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comprising classification means for, when said second 
input means inputs a plurality of additional 
information, classifying the additional information so 
as to multiplex the plurality of additional information 
with different color components of the image 
information. 

25. An image processing apparatus for reading an 
image having additional information multiplexed thereon 
and separating the additional information, comprising: 

read means for reading the image; 

detection means for detecting a position where 
the additional information is multiplexed in the image; 
and 

separation means for specifying the additional 
information multiplex position of the image on the 
basis of a detection result from said detection means 
and separating the additional information from the 
specified position. 

26. The apparatus according to claim 25, wherein said 
detection means reads a predetermined dot pattern 
printed in a predetermined region of the image to 
detect the additional information multiplex position. 

27. The apparatus according to claim 25, wherein said 
detection means regards a position defined in 
accordance with a predetermined image format as the 
additional information multiplex position. 



28. The apparatus according to claim 25, wherein said 
read means comprises a scanner. 

29. The apparatus according to claim 25, wherein said 
separation means comprises measurement means for 
measuring an average density value near the specified 
additional information multiplex position and a 
difference between a maximum value and a minimum value 
of a local average pixel value, and extracts a value of 
a code representing the additional information on the 
basis of the average density value and difference 
measured by said measurement means. 

30. The apparatus according to claim 29, wherein said 
separation means comprises selection means for 
selecting one of a plurality of threshold values on the 
basis of the average density value, and extracts the 
value of the code by comparing the threshold value 
selected by said selection means with the difference. 

31. An image processing method of multiplexing 
additional information with image information and 
separating the additional information from an image 
having the additional information multiplexed, 
comprising : 

a first input step of inputting the image 
information; 

a second input step of inputting the additional 
information; 
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a quantization step of multiplexing the 
additional information with the image information and 
executing pseudo-halftoning processing so as to express 
the additional information by a set of minimum number 
of pixels readable by an image reading apparatus in 
consideration of resolution of an image output 
apparatus for outputting the image information as an 
image and resolution of the image reading apparatus for 
reading the image output from the image output 
apparatus; 

an output step of forming an image on the basis 
of image data processed by pseudo-halftoning processing 
and outputting the image; 

a read step of reading the image; 

a detection step of detecting a position where 
the additional information is multiplexed in the image; 
and 

a separation step of specifying the additional 
information multiplex position of the image on the 
basis of a detection result in said detection step and 
separating the additional information from the 
specified position. 

32. The method according to claim 31, wherein the set 
of pixels which is generated in said quantization step 
to express the additional information is formed from 
continuous pixels having a first quantization value, 
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the continuous pixels having the first quantization 
value having a size determined in consideration of the 
resolution of the image reading method. 

33. The method according to claim 32, wherein said 

5 the quantization step generates, adjacent to the set of 
continuos pixels having the first quantization value, a 
set of continuos pixels having a second quantization 
value for compensating a density expressed by the set 
of continuos pixels having the first quantization value 
10 so as to maintain an average density of image 

information in a neighboring region of pixels on which 
the additional information is to be multiplexed. 

34. The method according to claim 33, wherein the 
additional information multiplexed on the image 

15 information is expressed by a combination of the set of 
continuous pixels having the first quantization value 
and the set of continuous pixels having the second 
quantization value. 

35. The method according to claim 31, wherein said 
20 separation step comprises a measurement step of 

measuring an average density value near the specified 
additional information multiplex position and a 
difference between a maximum value and a minimum value 
of a local average pixel value, and a value of a code 
25 representing the additional information is extracted on 
the basis of the average density value and difference 
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measured in said measurement step. 

36. The method according to claim 35, wherein said 
separation step comprises a selection step of selecting 
one of a plurality of threshold values on the basis of 

5 the average density value, and the value of the code is 
extracted by comparing the threshold value selected in 
said selection step with the difference. 

37. A computer-readable memory which stores a program 
for executing image processing of multiplexing 

10 additional information with image information or/and 
separating the additional information from an image 
having the additional information multiplexed, said 
program comprising: 

a code for executing first input processing of 

15 inputting the image information; 

a code for executing second input processing of 
inputting the additional information; 

a code for executing processing of multiplexing 
the additional information with the image information 

20 and executing pseudo-halftoning processing so as to 

express the additional information by a set of minimum 
number of pixels readable by an image reading apparatus 
in consideration of resolution of an image output 
apparatus for outputting the image information as an 

25 image and resolution of the image reading apparatus for 
reading the image output from the image output 
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apparatus ; 

a code for executing processing of forming an 
image on the basis of image data processed by 
pseudo-halftoning processing and outputting the image; 

a code for executing read processing of reading 
the image; 

a code for executing detection processing of 
detecting a position where the additional information 
is multiplexed in the image; and 

a code for executing separation processing of 
specifying the additional information multiplex 
position of the image on the basis of a detection 
result in the detection processing and separating the 
additional information from the specified position. 
38. An image processing method of multiplexing 
additional information with image information, 
comprising: 

a first input step of inputting the image 
information; 

a second input step of inputting the additional 
information; 

a quantization step of multiplexing the 
additional information with the image information and 
executing pseudo-halftoning processing so as to expres 
the additional information by a set of minimum number 
of pixels readable by an image reading apparatus in 



consideration of resolution of an image output 
apparatus for outputting the image information as an 
image and resolution of the image reading apparatus for 
reading the image output from the image output 
apparatus; and 

an output step of forming an image on the basis 
of image data processed by pseudo-halftoning processing 
in said quantization step and outputting the image; 
39. A computer-readable memory which stores a program 
for executing image processing of multiplexing 
additional information with image information, said 
program comprising: 

a code for executing first input processing of 
inputting the image information; 

a code for executing second input processing of 
inputting the additional information; 

a code for executing quantization processing of 
multiplexing the additional information with the image 
information and executing pseudo-halftoning processing 
so as to express the additional information by a set of 
minimum number of pixels readable by an image reading 
apparatus in consideration of resolution of an image 
output apparatus for outputting the image information 
as an image and resolution of the image reading 
apparatus for reading the image output from the image 
output apparatus; and 
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a code for executing output processing of forming 
an image on the basis of image data processed by 
pseudo-halftoning processing by guantization processing 
and outputting the image. 

40. The apparatus according to claim 16, wherein the 
additional information is expressed by a color 
component for which a set of pixels is generated by 
said quantization means. 

41. An image processing apparatus, comprising: 
input means for inputting an image; 
attachment means for attaching predetermined 

information to the image input by said input means; and 
output means for outputting the image to which 

the predetermined information is attached by said 

attachment means, 

wherein said attachment means adaptively attaches 

the predetermined information on the basis of 

resolution at which the image output by said output 

means is read. 

42. An image processing method, comprising: 
an input step of inputting an image; 

an attachment step of attaching predetermined 
information to the image input in said input step; and 

an output step of outputting the image to which 
the predetermined information is attached in said 
attachment step, 
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wherein said attachment step adaptively attaches 
the predetermined information on the basis of 
resolution at which the image output in said output 
step is read. 

43. A computer-readable memory which stores a program 
for executing image processing, said program 
comprising : 

a code for executing input processing of 
inputting an image; 

a code for executing attachment processing of 
attaching predetermined information to the image input 
by the input processing; and 

a code for executing output processing of 
outputting the image to which the predetermined 
information is attached by the attachment processing, 

wherein the attachment processing comprises 
adaptively attaches the predetermined information on 
the basis of resolution at which the image output in 
the output processing is read. 

44. An image processing apparatus for attaching 
predetermined information to image information, 
comprising : 

input means for inputting the image information; 

and 

attachment means for attaching a plurality of 
different predetermined information to different color 
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components of the image information input by said input 
means, respectively. 

45. An image processing method of attaching 
predetermined information to image information, 
comprising : 

an input step of inputting the image information; 

and 

an attachment step of attaching a plurality of 
different predetermined information to different color 
components of the image information input in said input 
step, respectively. 

46. A computer-readable memory which stores a program 
for executing image processing of attaching 
predetermined information to image information, said 
program comprising: 

a code for executing input processing of 
inputting the image information; and 

a code for executing attachment processing of 
attaching a plurality of different predetermined 
information to different color components of the image 
information input by the input processing, respectively. 

47. An image processing apparatus, comprising: 
generation means for generating a plurality of 

types of second dot patterns corresponding to a first 
region smaller than a size of a first dot pattern 
representing predetermined information; and 
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embedding means for selectively embedding the 
plurality of types of second dot patterns in units of 
first regions. 

48. The apparatus according to claim 47, further 
5 comprising discrimination means for discriminating 

characteristics of image information in the first 
region, wherein 

said embedding means selectively embeds the 
plurality of types of second dot patterns in units of 
10 first regions in accordance with a discrimination 
result from said discrimination means. 

49. The apparatus according to claim 47, wherein the 
second dot pattern is a dot pattern formed from a 
single line. 

15 50. The apparatus according to claim 47, wherein the 
first dot pattern is formed by combining the second dot 
patterns . 

51. The apparatus according to claim 47, wherein said 
embedding means quantizes the first region to output 

20 quantized image information containing the second dot 
pattern. 

52. The apparatus according to claim 51, further 
comprising determination means for determining a 
quantization condition on the basis of the image 

25 information in the first region, the predetermined 
information, and the second dot pattern, whrein 



said embedding means quantizes the first region 
on the basis of the determined quantization condition. 

53. The apparatus according to claim 51, wherein the 
quantization is executed by pseudo-halftoning 

5 processing using error diffusion. 

54. The apparatus according to claim 48, wherein said 
discrimination means discriminates a quantization error 
previously generated in the first region by said 
embedding means . 

10 55. The apparatus according to claim 48, wherein said 
discrimination means discriminates a type of the second 
dot pattern previously embedded by said embedding means. 

56. The apparatus according to claim 48, wherein said 
embedding means inhibits embedding the second dot 

15 pattern when it is determined on the basis of the 

discrimination result from said discrimination means 
that the first region has a predetermined density. 

57. An image processing method, comprising: 

a generation step of generating a plurality of 
20 types of second dot patterns corresponding to a first 
region smaller than a size of a first dot pattern 
representing predetermined information; and 

an embedding step of selectively embedding the 
plurality of types of second dot patterns in units of 
25 first regions. 

58. A computer-readable memory, comprising: 
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a code for generating a plurality of types of 
second dot patterns corresponding to a first region 
smaller than a size of a first dot pattern representing 
predetermined information; and 
5 a code for selectively embedding the plurality of 

types of second dot patterns in units of first regions. 

59. An image processing apparatus for multiplexing 
image information and additional information different 
from the image information, comprising: 

10 decodability determination means for determining 

whether decoding is possible when a code is attached on 
the basis of a pixel value around a pixel of interest 
in the image information; 

quantization condition determination means for 

15 determining quantization condition on the basis of a 
determination result from said decodability 
determination means, the pixel value around the pixel 
of interest in the image information, and the 
additional information to be multiplexed; and 

20 quantization means for quantizing the pixel of 

interest in the image information by pseudo-halftoning 
processing under the quantization condition determined 
by said quantization condition determination means. 

60. The apparatus according to claim 59, wherein said 
25 decodability determination means determines 

decodability in accordance with an image density around 
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the pixel of interest. 

61. The apparatus according to claim 59, wherein said 
decodability determination means determines 
decodability in accordance with a black component 

5 density around the pixel of interest. 

62. The apparatus according to claim 59, wherein said 
decodability determination means determines 
decodability in accordance with edge information around 
the pixel of interest. 

10 63. The apparatus according to claim 59, wherein said 
quantization means quantizes the pixel of interest by 
pseudo-halftoning processing based on error diffusion. 

64. The apparatus according to claim 60, wherein said 
quantization means quantizes the pixel of interest by 

15 pseudo-halftoning processing based on error diffusion. 

65. The apparatus according to claim 61, wherein said 
quantization means quantizes the pixel of interest by 
pseudo-halftoning processing based on error diffusion. 

66. The apparatus according to claim 62, wherein said 
20 quantization means quantizes the pixel of interest by 

pseudo-halftoning processing based on error diffusion. 

67. An image processing method of multiplexing image 
information and additional information different from 
the image information, comprising the steps of: 

25 determining whether decoding is possible when a 

code is attached on the basis of a pixel value around a 



pixel of interest in the image information and 
determining quantization condition on the basis of a 
determination result, the pixel value around the pixel 
of interest in the image information, and the 
5 additional information to be multiplexed; and 

quantizing the pixel of interest in the image 
information by pseudo-halftoning processing under the 
determined quantization condition. 

68. An image processing apparatus for attaching 
10 predetermined information to image information, 

comprising : 

determination means for determining detectability 
of the predetermined information attached to the image 
information; and 
15 attachment means for attaching the predetermined 

information in accordance with the detectability 
determined by said determination means. 

69. An image processing method of attaching 
predetermined information to image information, 

20 comprising the steps of: 

determining detectability of the predetermined 
information attached to the image information; and 

attaching the predetermined information in 
accordance with the determined detectability. 
25 70. A computer-readable storage medium which stores a 
program for an image processing method of attaching 
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predetermined information to image information, said 
program comprising: 

a code for determining detectability of the 
predetermined information attached to the image 
5 information; and 

a code for attaching the predetermined 
information in accordance with the determined 
detectability. 

71. An image processing apparatus, comprising: 
10 input means for inputting image information; 

generation means for generating an amount 
representing a degree of complexity of the image 
information; and 

information attachment means for attaching 
15 predetermined information to the image information in 
accordance with the amount representing the degree of 
complexity. 

72. The apparatus according to claim 71, wherein said 
generation means comprises a degree-of -complexity 

20 detection means for detecting the amount representing 
the degree of complexity of the image from the image 
information . 

73. The apparatus according to claim 72, wherein said 
degree-of-complexity detection means comprises: 

25 pseudo-halftoning processing means for executing 

pseudo-halftoning processing for the image information; 
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compression processing means for compressing the 
image information after the pseudo-halftoning 
processing; and 

compression ratio calculation means for 
5 calculating a compression ratio of the image 
information after the compression processing. 
74. The apparatus according to claim 72, wherein said 
degree-of-complexity detection means comprises: 
frequency conversion means for executing 
10 frequency conversion for the image information; and 
average high-frequency power calculation means 
for calculating an average square-sum of a plurality of 
high-frequency components of conversion coefficients 
after the frequency conversion. 
15 75. The apparatus according to claim 72, wherein said 
degree-of-complexity detection means comprises: 

frequency conversion means for executing 
frequency conversion for the image information; and 

average high-frequency absolute sum calculation 
20 means for calculating an average absolute sum of a 

plurality of high-frequency components of conversion 
coefficients after the frequency conversion. 
76. The apparatus according to claim 71, wherein said 
information attachment means attaches to the image 
25 information the predetermined information different 
from the image information from said input means by 
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attaching a dot pattern. 

77. The apparatus according to claim 76, wherein said 
information attachment means controls a region where 
the information is to be attached, in accordance with 

5 the amount representing the degree of complexity of the 
image information, which is generated by said 
generation means. 

78. The apparatus according to claim 77, wherein said 
information attachment means controls a total amount of 

10 dot pattern to be attached to the image information by 
decreasing an information area interval for complex 
image information and by increasing the information 
area interval for simple image information. 

79. An image processing method, comprising: 

15 an input step of inputting image information; 

a generation step of generating an amount 
representing a degree of complexity of the image 
information; and 

an information attachment step of attaching 
20 predetermined information to the image information in 
accordance with the amount representing the degree of 
complexity . 

80. A computer-readable storage medium which stores 
an program for attaching predetermined information to 

25 input image information, said program comprising: 

a code for executing the input step of inputting 
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the image information; 

a code for executing the generation step of 
generating an amount representing a degree of 
complexity of the image information; and 
5 a code for executing the information attachment 

step of attaching predetermined information to the 
image information in accordance with the amount 
representing the degree of complexity. 

81. An image processing apparatus for superposing 

10 additional information different from image information 
on the image information and outputting the image 
information, comprising: 

input means for inputting the image information; 
pseudo-halftoning processing means for quantizing 
15 a pixel of interest in the image information; and 

additional information superposition means for 
selectively superposing a plurality of additional 
information each having a specific dot pattern in 
accordance with a density around the pixel of interest 
20 processed by said pseudo-halftoning processing means. 

82. The apparatus according to claim 81, further 
comprising generation means for generating, for 

low- and high-density regions, two types of additional 
information each having a specific dot pattern, the dot 
25 pattern for the high-density region having a pixel 

interval smaller than that of the dot pattern for the 
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low-density region. 

83. The apparatus according to claim 82, wherein 
said generation means generates at least two 
types of dot patterns suitable for the respective 
5 density levels, and 

the pattern for the high-density region has the 
pixel interval smaller than that of the pattern for the 
low-density region and a pixel density level higher 
than that of the pattern for the low-density region. 
10 84. The apparatus according to claim 81, wherein 

said additional information superposition means 
comprises density reference region determination means 
for determining a region for measurement of an image 
density, and pixel count calculation means for 
15 calculating the number of pixels present in the density 
reference region, and 

a predetermined threshold value is compared with 
the number of pixels obtained by said pixel count 
calculation means, and in accordance with a comparison 
20 result, the plurality of additional information are 
selectively superposed. 

85. The apparatus according to claim 81, wherein 

said additional information superposition means 
comprises density reference region determination means 
25 for determining a region for measurement of an image 

density, and total density value calculation means for 
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calculating a sum of density levels of pixels present 
in the density reference region, and 

a predetermined threshold value is compared with 
the value obtained by said total density value 
5 calculation means, and in accordance with a comparison 
result, the plurality of additional information are 
selectively superposed. 

86. An image processing method of superposing 
additional information different from image information 

10 on the image information and outputting the image 
information, comprising: 

an input step of inputting the image information; 
a pseudo-halftoning processing step of quantizing 
a pixel of interest in the image information; and 

15 an additional information superposition step of 

selectively superposing a plurality of additional 
information each having a specific dot pattern in 
accordance with a density around the pixel of interest 
processed in said pseudo-halftoning processing step. 

20 87. A computer-readable storage medium which stores a 
program code for an image processing method of 
superposing additional information different from image 
information on the image information and outputting the 
image information, said program code comprising: 

25 a code for the input step of inputting the image 

information; 
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a code for the pseudo-halftoning processing step 
of quantizing a pixel of interest in the image 
information; and 

a code for the generation step of generating a 
plurality of additional information each having a 
specific dot pattern; and 

a code for the additional information 
superposition step of selectively superposing the 
generated plurality of additional information in 
accordance with a density around the pixel of interest 
processed in the pseudo-halftoning processing step. 

88. An image processing apparatus for attaching 
predetermined information to image information, 
comprising : 

input means for inputting the image information; 

holding means for holding a plurality of dot 
patterns having different densities; and 

attachment means for selectively attaching the 
dot patterns to the image information in accordance 
with a density of the image information. 

89. An image processing method of attaching 
predetermined information to image information, 
comprising: 

an input step of inputting the image information 
a holding step of holding a plurality of dot 
patterns having different densities; and 



an attachment step of selectively attaching the 
dot patterns to the image information in accordance 
with a density of the image information. 

90. A computer-readable storage medium which stores a 
program code for an image processing method of 
attaching predetermined information to image 
information, said program code comprising: 

a code for the input step of inputting the image 
information; 

a code for the holding step of holding a 
plurality of dot patterns having different densities; 
and 

a code for the attachment step of selectively 
attaching the dot patterns to the image information in 
accordance with a density of the image information. 

91. An image processing apparatus for multiplexing 
image information and additional information different 
from the image information, comprising: 

input means for inputting the image information; 

quantization means for quantizing a pixel of 
interest in the image information; 

dot pattern holding means for holding a specific 
dot pattern representing presence of the additional 
information in advance; 

attachment position information generation means 
for converting the additional information into position 
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information as an attachment position of the dot 
pattern; 

density detection means for grasping a density 
state around the attachment position of the dot pattern, 
5 which is obtained by said attachment position 
information generation means; and 

additional information superposition means for 
determining, on the basis of a grasp result by said 
density detection means, whether the dot pattern is to 
10 be attached and superposing the additional information 
in accordance with a determination result. 

92. The apparatus according to claim 91, wherein said 
density detection means comprises: 

density reference region determination/holding 
15 means for determining and holding a density reference 
region for measurement of an image density in advance; 
and 

pixel count calculation means for calculating the 
number of output processing pixels present in the 
20 density reference region held by said density reference 
region determination/holding means. 

93. The apparatus according to claim 92, wherein said 
pixel count calculation means calculates the number of 
processing pixels present in the density reference 

25 region for all of CMYK components. 

94. The apparatus according to claim 93, wherein if a 
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value obtained by said pixel count calculation means 
equals a predetermined value for all the CMYK 
components, said additional information superposition 
means does not attach the dot pattern. 

95. The apparatus according to claim 92, wherein said 
pixel count calculation means calculates the number of 
processing pixels present in the density reference 
region for some of CMYK components except a specific 
component . 

96. The apparatus according to claim 95, wherein if a 
value obtained by said pixel count calculation means 
equals a predetermined value for some components except 
the specific component, said additional information 
superposition means does not attach the dot pattern. 

97. The apparatus according to claim 94, wherein the 
predetermined value is "0". 

98. The apparatus according to claim 96, wherein the 
predetermined value is "0". 

99. The apparatus according to claim 91, wherein said 
density detection means comprises: 

density reference region determination/holding 
means for determining and holding a density reference 
region for measurement of an image density in advance; 
and 

total quantization value calculation means for 
calculating a sum of quantization values of processing 
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pixels present in the density reference region held by 
said density reference region determination/holding 
means . 

100. The apparatus according to claim 99, wherein said 
total quantization value calculation means calculates 
the sum of quantization values of processing pixels 
present in the density reference region for all of CMYK 
components . 

101. The apparatus according to claim 100, wherein if 
a value obtained by said total quantization value 
calculation means equals a predetermined value for all 
the CMYK components, said additional information 
superposition means does not attach the dot pattern. 

102. The apparatus according to claim 99, wherein said 
total quantization value calculation means calculates 
the sum of quantization values of processing pixels 
present in the density reference region for some of 
CMYK components except a specific component. 

103. The apparatus according to claim 102, wherein if 
a value obtained by said total quantization value 
calculation means equals a predetermined value for some 
components except the specific component, said 
additional information superposition means does not 
attach the dot pattern. 

104. The apparatus according to claim 101, wherein the 
predetermined value is "0". 



105. The apparatus according to claim 103, wherein the 
predetermined value is "0". 

106. The apparatus according to claim 91, wherein said 
quantization means quantizes the pixel of interest in 

5 the image information by pseudo-halftoning processing. 

107. The apparatus according to claim 92, wherein said 
quantization means quantizes the pixel of interest in 
the image information by pseudo-halftoning processing. 

108. The apparatus according to claim 93, wherein said 
10 quantization means quantizes the pixel of interest in 

the image information by pseudo-halftoning processing. 

109. The apparatus according to claim 94, wherein said 
quantization means quantizes the pixel of interest in 
the image information by pseudo-halftoning processing. 

15 110. The apparatus according to claim 95, wherein said 
quantization means quantizes the pixel of interest in 
the image information by pseudo-halftoning processing. 

111. The apparatus according to claim 96, wherein said 
quantization means quantizes the pixel of interest in 

20 the image information by pseudo-halftoning processing. 

112. The apparatus according to claim 97, wherein said 
quantization means quantizes the pixel of interest in 
the image information by pseudo-halftoning processing. 

113. The apparatus according to claim 98, wherein said 
25 quantization means quantizes the pixel of interest in 

the image information by pseudo-halftoning processing. 
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114. The apparatus according to claim 99, wherein said 
quantization means quantizes the pixel of interest in 
the image information by pseudo-halftoning processing. 

115. The apparatus according to claim 100, wherein 

5 said quantization means quantizes the pixel of interest 
in the image information by pseudo-halftoning 
processing. 

116. The apparatus according to claim 101, wherein 
said quantization means quantizes the pixel of interest 

10 in the image information by pseudo-halftoning 
processing. 

117. The apparatus according to claim 102, wherein 
said quantization means quantizes the pixel of interest 
in the image information by pseudo-halftoning 

15 processing. 

118. The apparatus according to claim 103, wherein 
said quantization means quantizes the pixel of interest 
in the image information by pseudo-halftoning 
processing . 

20 119. The apparatus according to claim 104, wherein 

said quantization means quantizes the pixel of interest 
in the image information by pseudo-halftoning 
processing. 

120. The apparatus according to claim 105, wherein 
25 said quantization means quantizes the pixel of interest 
in the image information by pseudo-halftoning 
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processing. 

121. An image processing method of multiplexing image 
information and additional information different from 
the image information, comprising: 
5 a pseudo-halftoning processing step of inputting 

the image information and quantizing a pixel of 
interest in the input image information; 

a dot pattern holding step of holding a specific 
dot pattern representing presence of the additional 
10 information in advance; 

an attachment position information generation 
step of converting the additional information into 
position information as an attachment position of the 
dot pattern; 

15 a density detection step of grasping a density 

state around the attachment position of the dot 

pattern; and 

an additional information superposition step of 

determining, on the basis of a result obtained in said 
20 density detection step, whether the dot pattern is to 

be attached. 

122. An image processing apparatus for attaching 
predetermined additional information to image 
information, comprising: 
25 input means for inputting the image information; 

holding means for holding the additional 
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information; 

detection means for detecting a density of the 
image information, which is represented by a plurality 
of color components of the image information around an 
5 attachment position of the additional information; and 

control means for, when the density of the image 
information, which is represented by the plurality of 
color components and detected by said detection means, 
has a predetermined value, controlling not to attach 
10 the additional information. 

123. An image processing method in an image processing 
apparatus which has holding means for holding 
additional information and attaches predetermined 
additional information held by the holding means to 

15 image information, comprising the steps of: 

detecting a density of the image information, 
which is represented by a plurality of color components 
around an attachment position of the additional 
information in the image information to be processed, 

20 and when the detected density of the image information, 
which is represented by the plurality of color 
components, has a predetermined value, controlling not 
to attach the additional information. 

124. A computer-readable storage medium which stores a 
25 program for an image processing method in an image 

processing apparatus which has holding means for 
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holding additional information and attaches 
predetermined additional information held by the 
holding means to image information, said program 
comprising: 

5 a code for executing processing of detecting a 

density of the image information, which is represented 
by a plurality of color components around an attachment 
position of the additional information in the image 
information to be processed, and when the detected 
10 density of the image information, which is represented 
by the plurality of color components, has a 
predetermined value, controlling not to attach the 
additional information. 

125. An image processing apparatus for superposing 
15 additional information different from image information 
on the image information and outputting the image 
information, comprising: 

input means for inputting the image information; 
pseudo-halftoning processing means for quantizing 
20 a pixel of interest in the image information; 

generation means for generating additional 
information having a specific dot pattern; and 

additional information superposition means for 
superposing the additional information, while 
25 maintaining a density around an attachment position of 
the additional information, in accordance with presence 
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of a neighboring pixel around the attachment position 
of the additional information. 

126. The apparatus according to claim 125,- wherein 
said generation means calculates position information 

5 as the attachment position of the specific dot pattern. 

127. The apparatus according to claim 125, wherein 
said additional information superposition means 
comprises : 

first load means for loading the specific dot 
10 pattern; 

second load means for loading the attachment 
position information generated by said generation 
means; 

determination means for, in attaching the 
15 specific dot pattern to the image information, 

determining whether a pixel which is absent on the 
image information need be newly added; and 

off-dot processing means for, when said 
determination means determines that a new pixel has 
20 been added, converting a neighboring pixel around the 
pixel into an off -dot. 

128. The apparatus according to claim 125, wherein 
said additional information superposition means 
comprises : 

25 first load means for loading the specific dot 

pattern; 
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second load means for loading the attachment 
position information generated by said generation 
means ; 

density increase amount calculation means for, in 
5 attaching the specific dot pattern to the image 

information, calculating a density amount which has 
increased upon attaching the specific dot pattern; and 

off-dot processing means for converting, of 
pixels present in the region, a pixel corresponding to 
10 a value obtained by said density increase amount 
calculation means into an off-dot. 

129. The apparatus according to claim 128, wherein 
said off-dot processing means comprises: 

distance measurement means for measuring a 
15 distance to each pixel in the region; and 

off-dot processing means for sequentially 
converting pixels having a density corresponding to the 
value obtained by said density increase amount 
calculation means in ascending order of distances 
20 obtained by said distance measurement means. 

130. The apparatus according to claim 128, wherein 
said off-dot processing means comprises: 

off-dot processing order determination means for 
determining in advance an order of deletion of pixels; 
25 and 

off-dot processing means for converting pixels 
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having a density corresponding to the value obtained by 
said density increase amount calculation means in 
accordance with the off-dot processing order determined 
by said off -dot processing order determination means. 
5 131. An image processing method of superposing 

additional information different from image information 
on the image information and outputting the image 
information, comprising: 

an input step of inputting the image information; 
10 a pseudo-halftoning processing step of quantizing 

a pixel of interest in the image information; 

a generation step of generating additional 
information having a specific dot pattern; and 

an additional information superposition step of 
15 superposing the additional information while 

maintaining a density around an attachment position of 
the additional information in accordance with presence 
of a neighboring pixel around the attachment position 
of the additional information. 
20 132. A computer-readable storage medium which stores a 
program code for an image processing method of 
superposing additional information different from image 
information on the image information and outputting the 
image information, said program code comprising: 
25 a code for the input step of inputting the image 

information; 
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a code for the pseudo-halftoning processing step 
of quantizing a pixel of interest in the image 
information; 

a code for the generation step of generating 
5 additional information having a specific dot pattern; 
and 

a code for the additional information 
superposition step of superposing the additional 
information while maintaining a density around an 
10 attachment position of the additional information in 

accordance with presence of a neighboring pixel around 
the attachment position of the additional information. 

133. An image processing apparatus, comprising: 
input means for inputting image information; 

15 holding means for holding predetermined 

additional informations- 
attachment means for attaching the predetermined 

additional information to the image information in 

units of pixels; and 
20 adjustment means for adjusting a density of the 

image information around an attachment position of the 

additional information in accordance with a density of 

the additional information. 

134. An image processing method, comprising: 

25 an input step of inputting image information; 

a holding step of holding predetermined 
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additional information; 

an attachment step of attaching the predetermined 
additional information to the image information in 
units of pixels; and 

an adjustment step of adjusting a density of the 
image information around an attachment position of the 
additional information in accordance with a density of 
the additional information. 

135. A computer-readable storage medium which stores a 
program code for an image processing method, said 
program code, comprising: 

a code for the input step of inputting image 
information; 

a code for the holding step of holding 
predetermined additional information; 

a code for the attachment step of attaching the 
predetermined additional information to the image 
information in units of pixels; and 

a code for the adjustment step of adjusting a 
density of the image information around an attachment 
position of the additional information in accordance 
with a density of the additional information. 
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ABSTRACT OF THE DISCLOSURE 
A pattern which does not appear at a flat portion 
in normal binarization processing is set as a code 
pattern, and a code formed from this pattern is 
5 attached. At this time, code attachment with little 
degradation in image quality is implemented by 
selecting an unnoticeable pattern. 
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